DOCUMENT RESUME 



ED 050 228 



¥7 Oil 130 



h much. 

THEE 

INSTITUTION 

5FCNS AOENCY 

PUB DATE 
NOTE 



Goiualtz, Maria Elena 

An Optimal Sample Design lor a Job Vacancy Survey* 
National Industrial Conlerence Board, Inc. , New 
York, N.Y. 

Office ot Manpower Policy, Evaluation,- and Research 
(DOl) , Washington, D.C. 

Jun 68 

128p. 



ELRS FxxiCE EDRS Price MF-*0.65 KC-$6.56 

DISC E I FT o RS Employment Opportunities, *Labcr Economics, labor 

Force, Labor Market, ^Manpower Needs, ^Measurement 
Techniques, Occupational Surveys, ^Research 
M e thodolcg y 



AES IE ACT 

Job vacancy statistics are usetul both nationally 
and locally tc manpower \ ol lcyma kers m: (1) measuring labor 

shortages or surpluses, (2) identitymg employment trends m 
occupations ard industries, and (3) matching persons and jobs. The 
purposes of this study are to analyze the reliability ot vacancy 
estimates and tc jlan efficient sample designs of jet vacancy 
surveys. Ine report describes methods cf reliability measurement tor 
estimates ot job vacancies at a point in time and for estimates ot 
changes between surveys. The study found that sample design 
efficiency could be improved significantly by; (1) stratification by 
size or firm and by industry, (2) use ot smaller employers in 
samples, ana <J) neasurecent ot changes in job vacancies, rather than 
total vacancies. A related report is available as ID 043 726. (BH) 



ED 05 02 2 8 



US DEPARTMENT OF Hf M.TH, EOUCATION 
A WELFARE 

OFFICE OF EOUCATtON 
THIS DOC 'J ME NT HAS BEEN REPRODUCED 
exactly as received fromthe person or 

ORGANIZATION ORIGIN AT!> ,/ 'i IT PO'NTS OF 

View or opinions stated oo not neces 

SARILY REPRESENT OFFICIAL OFFICE OF EOU 
rmfiiu oo<;iTlON OR PDLICY 



AM OPTIMAL SAMPLE DESIGN FOR A JOB VACANCY SURVEY 



ky 



Marfa Elena Ganidlei 



Pn parr *1 by 

National Industrial Conference Board 
for 



The Office of Manpower Policy, Evaluation, and Rescaich 
Manpower Administration 
U. S* Department of Lab>r 



June, 1968 

O 

v i 

"H 



o 




1 



ii 



This report was prepared under Contract No# 8l-3*+-66-13 for the Man- 
power Administration , U.S* Department of Labor, under the authority of 
the Manpower Development and Training Act* Researchers undertaking such 
projects under the Government sponsorship are encouraged to express 
their own judgment# Interpretations or viewpoints stated in this 
document do not necessarily represent the official position or policy 
of the Deportment of Labor* 




2 



TABLE OF CONTENTS 



Page 



LIST OF TABLES 

ACKNOVMTOMBNTS viii 

I- INTRODUCTION AND SUMMARY IS 1-11 

Criteria for Sample Adequacy 1-3 

Summary of Report 1-6 

II- STRATIFICATION AND DATA SOURCE II: 1-9 

A. Stratification in a Job Vacancy Survey II - 1 

B. Selection of the NICB Sample II - 4 

S^immary . . II - 8 

III- MEASURES OF VARIABILITY Ill: 1-29 

A. Actual Measures of Variability for Each Survey Feriod . .Ill - 3 

1. Vacancies by industry . • • Ill - 3 

2. Vacancies by size Ill - 8 

3. Vacancy rate by industry • • • * Ill - 11 

Vacancy rate by Mize Ill - 14 

B. Measures of Variability for Changes Between Survey 

Periods Ill - 16 

1. Changes in vacancies by industry Ill -.16 

2 • Changes in vacancies by size . Ill - 19 

5. Changes in vacancy rate by industry • . • • Ill - 22 

4. Changes in vacancy rate by size .IZZ « 26 

Sunn&ry Ill - 28 

IV- A PROPOSED OPTIMAL SAMPLE DESIGN . IVs 1-44 

A. Selection of Strata for Optimal Allocation IV - 1 

B. Methods for Obtaining en Optimal Sample Design IV - 2 

er|c o 



iv 



Page 

C. Optimal Sample Design for Estimating Total Number 

of Job Vacancies • IV - 1J 

D, Optimal Sample Design for Estimating Changes in 



Number of Total Job Vacancies « IV - 19 

E, Optimal Sample Design for Estimating tbp 

Job Vacancy Rate •••••••««••« IV -24 

F, Optimal Sample Design for Estimating Changes 

in the Job Vacancy Rate •* ••»•»»•••»• IV - 29 

G* Comparison of Sample Designs • IV - 35 

Summary « ( IV - 



V- GENERAL METHODS FOR DETERMINING STRATA AND SAMPLE SIZES . V: 1 - 14 

A. The Choice of Stratification Variables V - i 

B. The Choice of the Number of Strata V - 2 

C. The Formation of Strata in the Population V - 3 

D. n : The Sample Si£e in Stratum g.....*...*V-5 

O 

Surjnary V - 13 

APPENDIX A - PROOPS OF UNBIASED AND CONSISTENT ESTIMATES 

OF ELEMENT VARIANCE AND ELEMENT COVARIANCE . A; 1 - 13 

BIBLIOGRAPHY B - 1 



o 

ERIC 



4 



V 



LIST OF TABLES 



Page 



1* Tol.nl Number oi‘ Job Vacancies, Standard Error t and 

Coefficient of Variation, by Industry Group , . 1 1 1—7 

P • Total Number of Job Vacancies, Standard Error, and Coefficient 

of Variation, by Employment Size III-10 

7* dob Vacancy Rato, Standard Error, and Coefficient of 

Variation, by Industry Group ........ I I 1-13 

**■ dob Vacancy Rate, Standard Error, and Coefficient of 

Variation, by Employment Size ..... II I- 13 

3* Clianges in Job Vacancies, Standard Error, and Coefficient 

of Variation, by Industry Group . . . . III-lS 



S. Changes in Job Vacancies, Standard Error, and Coefficient of 
Variation, by Employment Size . . , 

7. Changes in the Job Vacancy Kate, Standard Error, and 



Coefficient of Variation, by Industry Group I I 1-24 

S. Changes in the Job Vacancy Rate, Standard Error, and 

Coefficient of Variation, by Employment Size III-P7 

g. Element Standard Error for Total Job Vacancies and for 
Changes in Total Job Vacancies, and Estimated 

Total Survey Cost Per Firm IV- 6 

10. Element Standard Err*'!’ for the Total Job Vacancy Rate 

and for Changes in the Total Job Vacancy Rate • IV- 10 

11. Optimal Sample Size for Kstinwtes of Total Job Vacancies • . • IV-14 

IS. Optimal Sampling Ratios of Firms for Estimates of Total Job 

Vacancies IV- 13 

l 7 ’. Aveivige Optimal Sample Size and Largest Optimal Sample Size 

for Total Job Vacancies IV- 17 

14. Selected Sample Design for Estimating Total Job Vacancies 

to Obtain a Coefficient of Variation of O.Op » IV-lS 

I 1 '. Optima) Sampl ' Size for Estimates of Changes in Total Job 

Vacancies IV-20 

1(>. Selected Sample Design for Estimating Changes in Total Job 



Vacancies Which Measure 0.*H' of (E+-V) with °. Q V Confidence • • 




5 



iv-a 



vi 

Page 

17* Optimal Sampling Ratios of Firms for Estimates of Changes in 

Total Job Vacancies • • ••••»•«•• IV-23 

18* Largest Optimal Sample Size for Each Stratum to Estimate 
Three- month Changes in Vacancies of 0*5% of (E+V) vxth 
95% Confidence . . . . . IV- 24 

19. Optimal. Sample Size for Estimates of the Total Job Vacancy 

Rate IV-26 

20. Optimal Sampling Ratios of Firms for Estimates of the Total 

Job Vacancy Rate • IV~2? 

21. Selected Sample Design for Estimating the Job Vacancy Rate 

with a Coefficient of Variation of 0.05 IV-28 

22. Largest Optimal Sample Size for Each Stratum to Estimate the 

Job Vacancy Rate with a Coefficient of Variation of 0.05» • • IV-29 

23- Optimal Sample Size for Estimates of Changes in the Total 

Job Vacancy Rate IV- 30 

24. Selected Sample Design for Estimating Three-month Changes of 

0.5 or hore i.i the Job Vacancy Rate with 95% Confidence. • r IV-31 

25. Optimal Sampling Ratios of Firms for Estimates of Changes 

in the Total Job Vacancy Rate ....... ........ IV-32 

?6. Average Optimal Sample Size for Vacancy Kates and Three- month 

Changes in Vacancy Rates ..... IV-33 

2?« Largest Optimal Sample Size of Each Stratum for Estimating 
Three-month Changes of 0.5 or Hore in the Job Vacancy Rate 
with 95^ Confidence ••••«•••• IV- 34 

28. Per Cent Distribution of Employer Units in Optimal Sample 

Designs for Monroe County Compared with the MCB Surveys 

of Monroe County * IV -36 

29. Sample Size and Cost of Job Vacancy Surveys . IV -38 

30. Strata in Which Estimates for Changes Exceed Those for Totals: 

Percentages of Total Samples and Their Ratios •.«•«••. IV-39 

31* Ratio of Estimates for One Survey Period to Estimates for 

Three-month Changes for; Optimal Sample Size and Cost . • . IV-40 

32. Largest Satrple Size for Each Stratum of the Designs Given in 

Sections C to F . . . IV-41 

O 

ERJC 



6 



vii 



Page 

33 • Strata in Which Optimal Percentages Are Larger for Estimates 

of Vacancy Rates than for Estimates of Job Vacancies • • • • IV-42 

34. Largest Sample Size for Each Stratum of the Designs to 

Estimate Three-month Changes Given in Tables OS and 27 * . . • • IV- 43 

35« Optimal Size Scrata for Rochester , N.Y. , Nev» York, N.Y. , and 

Richmond, Virginia, in. 1965 V-4 

36 , Estimated Rate of Current Job Vacancies by Area, April 1, i 960 

and April 15, 1965 • . • • • • • , V-5 

37, Element Standard Errors for Total Job Vacancies and Estimated 

Survey Cost Per Firm for Rochester Surveys in 1965 V -8 

38 , Optimal Sample Sizes for Estimating Total Job Vacancies in 

Rochester, 1965, and for a Job Vacancy Rate of 1*5 V-10 

39# Largest Optimal Sample Size of Each Stratum for Estimating Total 
Job Vacancies Found in Rochester with Coefficients of Variation 
of 0.05 and 0.10 V-ll 

40. Average Optimal Sample Sizes for Estimating Total Job Vacancies 

According to Specified Job Vacancy Rates V-12 



o 

ERIC 



7 



V t 1 > 



ACKNOWHilDO^UTG 



The present study is one of several growing out of u h?B r s earlier 
report, Me a su r i n g J ob V ; j c an c i e s . This series of studies has been nnde possible 
by a generous grant from the Office of Manpower Po L i cy , Evaluation, and he search, 
Manpower Admin i st rat ion, U . S . Department of Labor . 

l'his report was prepared in the Special Projects Department in the 
Office of the I'hicf Economist under the general direction of Martin K. Gtainsbrugh. 
Ihe topic itself was suggested by John 0. Myers, Senior Economist in the Special 
Pr jocts Department, wlio also visualized the entire project and subsequently 
cl a r! bated analytical suggestions and stimulating comments. Daniel Creamer, 
Manager of the Special Pro j acts Departnient, not only offered the encouragement 
vh i ch made the study f e a s ib le , but throughout pr ov i ded use fu 1 critic! sm . J o soph 
Waksberg, Chief of the Statistical Methods Division of the U. f. Bureau of the 
Census, had pointed out several pertinent new applications which could be in- 
terestingly extended from the results propounded in the previous PICE report, 
and his suggestions, at different stages in the development of this project, 
were both timely and constructive. Alan f unter , Coordinator of the Survey 
Methods Staff of the Dominion Bureau of Statistics of Canada, provided helpful 
advice at the time the analysis of the material was being planned. Professor 
Elizabeth Yen of the Department of Mathematical Statistic c at Columbia Un’/ereity 
offered consistently illuminating and practical guidance in the organ! za\ ion of 
material and focusing of priorities. Comments by members of the staff the 
Office of Manpower Planning, Evaluation, and Research on n preliminary dr>f r 
v;ere influential in broadening the scope of the study and in sharpening some of 
its conclusions. 

The computations have been carried out efficiently by NTCB staff 
members, Walter B. Frown and Barbara Feld, and the computer programs were 
designed by Michael Papantoniou and Judy Rosenthal under the supervision of 
Luke McCherry . 



To all my deepest appreciation. 

Although this study is neither exhaustive nor all- inclusive , it is 
offered with the hope that it will further the study of techniques appli -able 
cample design for job vacancy surveys. 



SLRJC 



M.K.O. 



. 1-1 



Chapter I: INTRODUCTION AND SUMMA RY 

Ii L9 C'\ the National Industrial Conference 7 'oard published the 
findings if a. three-year project on the feasibility of collecting job vacancy 
statistics.* That study explored the problems of pj sparing an operational 
definition of a job vacancy and investigated the cost ana procedures of 
sample survey methods, including sample designs and daca collection tech- 
niques. The present study has two purposes: to analyze the reliability of 

vacancy estimates, and to plan efficient sample designs for job vacancy 
surveys . 

Job vacancy statistics have important potential uses as guides to 
policy both nationally and in local areas. The latter category includes 
several different possibilities. For example, it is important to know 
whether or not a. given local area is experiencing a shortage or a surplus 
of labor and to know how the situation is changing; that is, whether the 
local labor market is "tightening” or "loosening." Another use is to aid 
and identify those occupations and industries that are growing and those 
that are declining, so that persons concerned with job training a.t all 
levels will be better informed and thus be able to make better decisions 
than would be likely in the absence of such information. Also, the matching 
of persons and jobs would be greatly aided by an increase in information 
made available to both job seekers and employers in the form of numbers of 
vacancies by occupation and skill requirements. For all these uses, ade- 
quate, reliable statistics for each important labor market area in the 
nation are necessary. 

Two aspects of reliability are relevant. The first is the 
reliability of estimates of job vacancies at a point in time (usually the 




M easuring Job Vacancies , Studies in Business Economics No. 97, The 
Conference Board, 19^7* 
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survey dote), both in total and for specific categories. The second is the 
reliability of estimated changes in job vacancies between surveys, again 
both in total and for selected breakdowns. A major objective of this paper 
is to set forth approaches to the measurement of reliability for both esti- 
mates of vacancies at a. point in time and of changes between suiveys. The 
measurement of variability was examined in The Conference Board report re- 
ferred to above,* although the treatment of the variability of totals was 
incomplete. It did not touch at all the variability of changes. The reli- 
ability of the job vacancy rate (100 V/E+V) , which is a relative measure of 
job vacancies, as well as changes in the rate, is also analyzed here. 

An important aspect of the feasibility of job vacancy surveys is the 
problem of obtaining information that is sufficiently reliable, for the uses 
cited above, at reasonable cost. This may be solved by preparing estimates 
of sample size and combining them with estimates of cost per respondent to 
obtain estimates of total survey costs. 

The second principal objective of the present study is to explore 
techniques for designing efficient samples for selected areas, taking into 
account the prevailing job vacancy rate, the variability of job vacancies, 
and the costs per employer.** The variability measures and costs vary among 
different groups of employers. Some employer groups (with specified employ- 
ment sizes and of given industries) can be identified in advance of the 
survey and therefore adequately enter into an efficient sample design. In 
this connection, the adequacy of the sample denotes that the information on 
numbers of vacancies and on changes in these numbers between surveys is 
sufficiently reliable for economic analysis. 



* Ibid. , Chapter 8. 




The terms "employer," "firm," "enterprise," end 'establishment" are 
used interchangeably in this report. 
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Criteria for Sample Adequac y 

It is difficult to choose criteria, for sample adequacy in advance. 
Extensive experience with jot vacancy statistics for policy- and decision- 
making in official and pri/ate use and for analysis of the value of the data 
as a measure of labor market activity will help to determine more precise 
criteria . 

Some criterion must be adopted in advance, however, so that the 
sample size and the associated level of accuracy can be chosen. It is 
clearly best to state the proposed criterion explicitly, however scant the 
information available for choosing it. Ihis permits discussion and evalua- 
tion of the criterion in advance of expensive data collection and may thus 
lead to clarification of the purposes of the survey, a refining of concepts, 
and in general better, more valuable data. 

One procedure worthy of consideration is to determine a confidence 
interval for estimates of total number of job vacancies in the local area, 
specifying the probability of success and the width of the interval as a 
percentage of the estimated total. An example, to make the concept less 
abstract, may be taken from the original design of The Conference Board 
sample in Monroe County, New York (the Rochester area). The sample was 
de. c igned to provide an interval estimate of the total number of job vacancies 
within 10 $ of the estimated total, with a probability of 0.9 5> this corre- 
sponds to a coefficient of variation of 0.05. The criterion was not satis- 
fied in the 1965 surveys, however (see Chapter III of this report). For 
the purposes of studying individual industries and occupations, additional 
criteria, of this type may be necessary, where the accuracy of subtotals of 
job vacancies is specified in advance. 

A similar, yet statistically distinct, criterion is associated 
with estimation of the proportion of jobs that are vacant at a point in 

0 
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time. This may he referred to as the job vacancy rate and defined as the 
ratio of total job vacancies to the sum of total vacancies and total employ- 
ment, or V/E+V. This ratio is a counterpart to the unemployment rate and is 
therefore more conveniently stated in percentage terms, or lOOV/E+V. Reason- 
able criteria for accuracy of an estimate of the job vacancy rate might be 
constructed that axe analogous to those for accuracy of an estimate of total 
job vacancies. Thus, we might seek to obtain, with a certain predetermined 
probability of success, an estimate of the job vacancy rate for an area that 
is within a. specified per cent of the current total. For example, we might 
wish to obtain an estimate of the job vacancy rate that if. within 10$ of the 
actual job vacancy rate, with a probability of 0.95* 

A different type of criterion is associated with the secure ey of 
changes in job vacancies. Here we must distinguish between changes in 
absolute number and changes in the job vacancy rate, for these may differ 
considerably according to variations in employment. Changes in the job 
vacancy rate indicate whether the local labor market is becoming more, or 
less "tight,” and is thus an important indicator o A economic conditions in 
an area. Changes in the (absolute) number of job vacancies, on the other 
hand, are important for many decisions about training and placement. 

For both types, we use criteria based on a change in the relative 
number of job vacancies) the criteria differ according to the base. The 
size of the labor market should be introduced as a base in measuring the 
importance of changes. Obviously a change of 500 vacancies has a different 
significance in a labor market such as New York City, with a labor force of 
more than 5.4 million (within New York State), than it has in Binghamton, 
wi L h a labor force of 119*000. The criterion needed for charges in the job 
vacancy rate is based on the magnitude of a change that might be considered 
economically important. That is, the sample should be able, with a certain 
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probability of success, to detect a change in labor market conditions that 
is significant in economic terms. * We believe that the detection of a. 
change cf 0.5 percentage points In the job vacancy rate in a local area 
wolf d be an adequate requirement., with a probability of 0 . 95 * A more 
stringent requirement would be to detect a change of 0.2 percentage points, 
with the same probability. 

A large change in the total number of job vacancies may occur with 
no appreciable change in ohe job vacancy rate. This can happen if both total 
vacancies and total employment rise (or fall) in similar proportions. To 
establish the magnitude of absolute changes in vacancies which are considered 
economically significant, two possible levels of change are examined: 0.5$ 

and 0.2 $ of the srm of employment and vacancies. The size of a significant 
change must be related to a fixed base, which must be estimated at the time 
the survey is being planned. This base is an estimate of the average number 
of jobs (employment plus vacancies) which the area surveyed will have during 
the survey period. The tabulation below shows the magnitude of the changes 
in total job vacancies, corresponding to the estimated size of the labor 
market area during the survey period and to specified per cent changes. 



Number of Job Vacancies Corresponding to 
Specified Per Cent Changes 



Estimated Size of 
Labor Area 
(E+V) 


Number of Vacancies 


Corresponding to 


0.5 Per Cent Change 


0,2 Per Cent Change 


100,000 


500 


200 


200,000 


1,000 


hOO 


500,000 


2,500 


1,000 


1,000,000 


5,000 


2,000 



* This criterion was suggested by Joseph WaXsberg of the U. S. Bureau of 
the Census. 
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It should be made clear that the criteria selected indicate whether 
an economically significant change has taken place at all, and do not serve 
to determine the magnitude of the change. Thus if the 0 .5$ criterion were 
adopted, and if the number of job vacancies increased by 2,000 in a labor 
area, with 500,000 jobs, we would not be able to state, with a comidence 
leveL of 0.95 , that there had been a change in the total number of vacancies; 
a change of at least 2,500 vacancies would be necessary to justify such a 
statement . 

Summa >»y o f Report 

The incidence of job vacancies varies widely among employers. To 
the extent that employers car: be divided into groups, or strata* that are 
relatively homogeneous with respect to the incidence of job vacancies, a 
giver degree of accuracy can be obtained with a correspondingly smaller 
sample (and at lower cost). The goal, therefore, is to determine those 
characteristics that are associated with the variability of job vacancies, 
to stratify the population according to those characteristics, and to select 
a sample separately within each stratum. If this is done successfully, the 
sample will be, with respect to the variability of job vacancies, relatively 
homogeneous within each stratum and relatively heterogeneous among strata. 

Of course, practical stratification requires that the character- 
istics distinguishing the strata be identifiable in advance. That is, the 
Lists from which the sample is drawn must contain information on the charac- 
teristics used for stratification. On the sanpling lists, the characteristics 
available for employers, which are closely related to vacancies, are employ- 
ment size and industry. Thus the original Conference Board sample for 
Rochester was stratified by employment size and industry. That sample pro- 
vided data on job vacancies by employment size and by industry, for three 
^ntes in 1965: mid-February, mid-May, and mid-August, as well as on changes 
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between these dates. A detailed description of the sample design used for 
the NTOB surveys of Monroe County is included in Chapter TI . 

Computation formulas have been developed for measures of the 
variability of job vacancies , including numbers of job vacancies and the 
job vacancy rate at a point in time, and changes in these numbers and rates 
(Chapter III) . Application of the formulas to the 1965 data provides sets 
of estimates of variability that should have some general applications. The 
degree of variability differs among the three surveys; the largest value is 
used here in an effort to avoid understatement of the extent of variation. 

The standard error of the job vacancy total in the Rochester area, was 553 
in the February survey , while the total proper was 7*9^7- This corresponds 
to a coefficient of variation of 0.07, and indicates that the criginal goal 
of estimating vacancies within 10$ of the total value with a. probability of 
0.95 was not met. The indicated range for 0.95 probability is 14$. A 
sinular result (coefficient of variation of 0.07) was found for the estimate 
of the job vacancy rate in February. 

Also of interest are the estimates for industry groups and employ- 
ment size classes. Variability, measured by the size of the standard error, 
was high for the following industry groups: construction j durable manufac- 

turing; public utilities and transportation; and trade (retail and wholesale' 1 . 
Among employer size groups, variability was greatest for the smaller employers, 
tho.se with employment of fewer than 10 workers, whether measured by size of 
the standard error or by the coefficient of variation. 

In the Rochester sample, all employers with ?50 or more, employees 
were included, so that there is no sampling variability associated with t h e 
job vacancies of these employers. To the extent that vacancies in an indus- 
try or size group represent those of the larger employers, neither the 
standard error nor the coefficient of variation reflects the extent of 

15 




variability. The comment about one significance of the measures cited is 
not intended to imply that the standard error is without va,lue . On the 
contrary, the standard error indicates the precision of the results of a 
survey and is therefore essential to an evaluation of these results. The 
standard error does not, however, furnish the best guide to sample design; 
other measures are needed for that purpose. 

The criterion suggested above for adequate sample accuracy for 
estimates of change is that a change of at least 0.5 percentage points in 
the job vacancy rate is detectable ..’ith probability of 0.95. The standard 
error of a change in the job vacancy rate should thus be less than 0.25 
percentage points. The standard error computed from the Rochester data for 
the February to May change was 0.22, while for the May to August change it 
wa.s 0.l6. Thus the sample is of adequate size according to the 0.5 percent- 
age point rule. The actual changes in the job vacancy rate were 0.06 points 
from February to May and 0.22 points from May to August, 1965* 

The estimated total number of jobs (E+V) in the Rochester area wa,, 
about 263,000 in February 1965 and 278,000 in May 1965 . Changes of 0.5 
points from February would consequently be about 1,306 vacancies, and from 
May about 1,390 vacancies, while changes of 0.2 points would be 526 and 
556, respectively. The standard errors of the change in the total number 
of job vacancies were 577 for the February to May period and 4^9 for the 
May to August period. Two standard errors, corresponding approximately to 
0.95 probability, are thus 1 , 15 ^ and 898 , respectively, for the two inter- 
vals. The Rochester sample again appears to be of adequate size for the 
0.5 point rule. 

The second principal objective of this study is to develop guides 
for sample selection at minimal cost, or optimal sample selection (Chapter 
IV). Here we set as one goal the selection of a sample that is of adequate 



precision to permit an estimate of the total number of job vacancies with a 
coefficient of variation of 0.025, 0.05 s and 0.10, These values correspond 
to 97/ confidence intervals for total vacancies* V', in which two standard 
errors are 5$, 10$, and 20$ of Vh 

The second goal is the selection of a, sample that will detect, 
with a probability of 0.95> changes in job vacancies that represent a certain 
predetermined per cent of all jobs in uhe area before the cnange. The change 
we examine is 0.5 percentage points. 

The relevant measure of variability of job vacancies for sample 
selection is the element standard error of each stratum. This is the 
familiar estimate of the standard deviation: in this case, the standard 

deviation of the job vacancies reported by the employers in a stratum.* 

The variability measure is combined with an appropriate cost figure to 
compute the optimal sample allocation among the strata. The strata are 
chcsen on the basis of the average number and variability of vacancies, as 
well as the cost per employer. 

Examination of the cost figures, the element standard errors, and 
the mean number of vacancies, computed for "a ious industry and employment 
size classifications, led to the selection of lk strata., 7 size groups 
cross-classified by 2 industry groups. The largest size group, 2,500 or 
more employees, may not be appropriate for labor market area.s of substan- 
tially larger or smaller size than the one studied. In a larger area, the 
lower bound of the largest size group would probably be greater than 2,500, 
while for a smaller area, the lower bound would probably be smaller than 
2,500. This can be determine by examining the distribution of employers 
by employment size for a specific area. 



* This measure is multiplied by a raising factor based on the sampling 
fraction to obtain the standard error, used to evaluate the accuracy of 
an estimated total. See formula (2) in Chapter III. 
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The conclusions listed below are drawn from an examination of 



optimal sample designs computed according to the objectives stated above. 
They depend, to some extent, on the nature of the area studied. However, 
we believe that they have a lurge degree of applicability to lire as with 
other industrial structures and labor market situations. 

1. Stratification by size of firm and by industry improves sampling 
efficiency for vacancy surveys. 

2. Survey costs vary significantly by size of employer in surveys 
seeking detailed description of each class of job vacancy. This 
consideration should be taken into account to obtain an efficient 
sample design. 

3. The criteria chosen for mearuring changes in job vacancies may be 
met with smaller and therefore less costly samples than the 
criteria for measuring cither total vacancies or the job vacancy 
rate (see Chapter IV), 

4. It thus appears that the detection of changes in job vacancies is 
more ea.sily and less expensively achieved than the estimation of 
total numbers of vacancies., if the criteria stated ere reasonable 
(see Chapter IV) . 

While the sample design for job vacancy surveys of a given area 
must take into account the characteristics of the establishments included 
and the prevailing job vacancy rate, it also must provide for the ultimate 
breakdown and the degree of reliability desired for the estimates (Chapter 
V) . Optimal strata boundaries are functions of both the jize distribution 
of employers and the number of employees in the largest firms. The optimal 
sample size for an area must, be increased as the job vacancy rate diminishes. 
For example, in a design like the one for Rochester, where the vacancy rate 
was approximate ly 3*0, a sample size of 574 employers gives estimates of 
vacancies with a coefficient of variation of 0.05. However, if the vacancy 
rate were 1.5j a sample of 1,500 would be necessary to obtain the same level 
of reliability for the estimated number of vajancies. On the other hand, 
less stringent requirements of reliability in estimating vacancies permit 



reduced sample sizes. Thus, in an area like Rochester a sample of 2l6 
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employers would be sufficient to estimate vacancies with a coefficient of 
variation of 0.10, while one of 57*+ would he necessary for estimates of 
vacancies with a coefficient of variation of 0.05. 

The methods for estimating optimal boundaries for strata, and 
sample sizes presented in Chapter V have generalized the detailed results 
of Chapter IV. These methods can he applied in general to areas with 
characteristics differing from those found in Rochester. The specific 
factors which determine the optimal sample design for an area are: 

1. the number of establishments (sampling units), 

2. the distribution of establishments into strata according to 
number of employees and industry, 

3. the differences among strata in vacancy variability and in 
survey cost per firm, and 

4. the job vacancy rate. 
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Chapter II: STRATIFICATION AND DATA SOURCES 



In this chapter, we develop a theoretical description of strati- 
fication, a feature of sample design used to classify firms and thereby 
improve the accuracy of statistical estimates. Although we are interested 
in measuring unfilled jobs, the sampling unit by necessity is the firm. * 
The accuracy of estimates of job vacancies is improved if firms are classi- 
fied by relevant characteristics, such as employment size or type of 
industry, and the sample is selected within homogeneous strata. 

A) Stratification in a Job Vacancy Survey 

Job vacancies occur within enterprises, government, nonprofit 
organizations, and households. Although private households may employ 
people on a part-time or full-time basis, they typically have not been 
included in sample surveys on job vacancies for local labor areas. To 
include a reliable sample of households would add disproportionately to 

survey Losts. This follows from the low incidence of households engaging 

*# 

employees. Thus the sampling unit is the firm, including nonprofit 
organizations and government. At a point in time, firms have a given 
number cf jobs available, some of which may be filled and some vacant. 
Estimates of unfilled Jobs are derived from the data collected from the 
fines in the sample. 

Certain features of sample design can reduce the cost of obtain- 
ing a desired degree of precision in the estimates. Specifically, the 
grouping of members of the population by characteristics closely related 
to (a) average size of the object of measurement, (b) variability of the 

* Although the sampling unit generally corresponds to the Census Bureau*s 
definition of ''establishment , ,f irultiple units having a central hiring 
office have been regarded as one sampling unit* 

M For a national survey of job vacancies in households see Samuel Saben, 
"Regular Jobs for Household Help," Monthly: Labor Review, October 1965. 
Vol» 88, No. 10, pp. 1,228-1,229* ~ 
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object of measurement , and (c) cost per unit sampled, followed by the selec- 
tion of random samples within each group, will help to produce good estimates 
at low cost. The classification of the population into groups, within which 
random samples are selected, is referred to as stratification. This method 
ensures the proper representation in the sample ef each stratum and, there- 
fore, reduces the variance. The variance of the stratified sample is then 
composed only of the variation within the strata, for the variance among 
strata is eliminated. To obtain the greatest gains from stratification, 
the analyst tries to maximize the differences among strata and to minimize 
the differences within strata, with respect to both variability and cost* 

In a survey designed to measure job vacancies, the average size and the 
variability of vacancies are measured by the arithmetic mean and the stand- 
ard deviation of the vacancy variable, while the cost is that of the sam- 
pling unit (the firm). Since units in the population must be identified 
by the stratifying characteristics, factors to be used for stratification 
are limited to those available in the sampling frame. On occasion this 
constraint frustrates the attempt to choose the most relevant characteris- 
tics for stratification purposes. 

The most comprehensive list of employers in a given labor area 
is the roster of employers covered by the state unemployment insurance law. 
This list has been the starting point for the NICB survey end for surveys 
sponsored by the Bureau of Employment Security. Thus, the NICB in its 
survey used the list of firms covered by the New York State Unemployment 
Insurance Law. This source includes a registration number, a code identi- 
fying geographic areas, size of emplo^mf^nt each month, industry of firm, 
and certain data on payrolls. The geographic area code was used to select 
the sample of firms in Monroe County. Firms were ordered by registration 

O 
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number which relates to the dfte on which the firm joined the New York State 
unemployment insurance system. 

Employment size and type of industry of firms are the two strati- 
fying characteristics considered most relevant to a survey on job vacancies. 
Since these two classification variables are not closely related to each 
other, it was considered advisable to include both in the sample design. 

Larger firms were expected to have a larger variance in the 
number of job vacancies than smaller firms. That is, a greater homogeneity 
is expected in the strata corresponding to smaller firms. Since for opti- 
mal stratification the sampling fraction should be proportional to the 
standard deviation and inversely proportional to the square root of the 
cost per unit in the stratum, one would use a larger sampling fraction for 
the scrata including larger firms.* Accordingly, the sampling fraction 
used in the selection of the sample was varied by size of firm. The esti- 
mates of the variability of job vacancies by size of firms are given in 
Chapter III. 

The average number and the variability of vacancies also differ 
markedly among industry groups. Industries that have high growth rates, 
or wide seasonal or cyclical variations, often have high vacancy rates. 

The construction industry, for example, has both high numbers of vacancies 
and high variability of vacancies relative to firms of the same size in 
other industries, during the period of seasonal upswing, Thus stratifica- 
tion by indastry will also increase sample efficiency, as indicated by the 
estimates of variability given in Chapter III. 

The number of strata used depends upon the accuracy of the infor- 
mation available on cost, average size, and variability, as veil as upon 
the number of categories for which estimates are desired. 

O * W. 0 . Cochran, Sampling Techniques, Second Edition, John Wiley & Sono. 

ERIC Inc., 1963, 95 '-$T- * * 
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A design with stratification by size, and substratification by 
industry, for three sizes, each having two industry substrata, would be as 
follows : 




A larger number of strata may increase the efficiency of the design. How^- 
ever, this may lead to difficulties when this procedure is carried to the 
extreme of including only one unit per stratum, since the variance of these 
strata cannot be estimated. The designs using stratification by employment 
size and sub3tratification by industry are subsequently amplified and analyzed 
in Chapter IV, where an attempt to obtain an optimal sample design for Rochester 
is carried out, and in Chapter V f where a generalized method is developed* 
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B) Selection of the NICB Sample* 

The design actually used in the 1965 surveys of Monroe County 
stratified firms by employment size (nine size strata were used). Within 
each employment size stratum, firms were ordered by industry (using 4 -digit 
Standard Industrial Classification (S.I.C.) code}, and a systematic sample 
was chosen from each size stratum. This design is a sample stratified by 
eize and by industry. 

The main part of the sample was selected from the list of 
employers paying New York State unemployment insurance payroll tax during 
the second quarter of 1964. However, thiB list did not include nonprofit 
institutions, government egencieB, or independent professionals not covered 
by the New York State unemployment insurance system. Thus supplementary 

* Based on Measuring Job Vacancies. 
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lists had to be developed. Another difficulty was the lack of reliable in- 
formation on the variability of job vacancies for different sizes of firms. 
Nevertheless, an attempt was made to obtain an optimal sample. It was 
assumed that job vacancies followed a Poisson distribution, that the survey 
agency's collection cost per vacancy did not vary for the different sizes 
of firas, and that the job vacancy rate was constant for all finan, except 
for the smallest size group ( l.e. , firms with measure of size 1~3), where 
it was higher. 

The U.S. Census Bureau publication County Business Patterns: 

First Quarter 1962 included a tabulation of the number of finna by eight 
employment size groups in Monroe County. The following sampling fractions 
were determined on the basis of these data, with adjustments for the 
smallest size group: 



Stratum 


Base Employment Size 


Sampling Ratio 


1 


0 


1:100 


2 


1-3 


1:142 


5 


4-7 


1:52 


4 


8-19 


1:28 


5 


20-49 


1:12 


6 


50-99 


1:6 


7 


100-249 


1:3 


8 


250 and over 


1 :1 



The New York State Division of Employment was requested to select 
from their computer records a systematic sample for each of the above size 
btreta. The firms within each size stratum were ordered first by firm 
registration code. It was assumed that this ordering would approximate a 
random ordering of the list with respect to job vacancies in these firms. 
Then firms were ordered by the 4-digit S.I.C. code, within the following 
Y^lndustry groups: 
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Industry Group 


S.I.C. 


Code 


1. 


Contract construction 


15-17 




2. 


Ordnance and durable manufacturing 


19, 24, 


25, 52-59 


3. 


Nondurable manufacturing 


20-25, 


26-51 


4. 


Public utilities and transportation 


40-49 




5. 


Wholesale trade 


50 




6. 


Retail tiade 


52-59 




7- 


Finance, insurance, and real estate 


60-67 




8. 


Services (not including medical, 
legal and educational) 


70-79 





The Division of Employment was instructed to use a larger sampling 
ratio within each size group in order to provide additional firms which 
could be used for pietesting as well as for replacement of possible non- 
respondents. In addition the Division was requested to provide a complete 
listing of the firms in \\e following industries: 



Industry Group 



S • I * C ■ Code 



1. Agricultural services, forestries* 

fisheries 01-09 

2* Mining 10-14 

3. Selected services (medical, legal. 

educetional, nonprofit organiza- 
tions, miscellaneous) 8 O-G 9 

4. Nonclassif iable 99 



After reviewing the agricultural and raining industries, which 
included very few firms in Monroe County, the sampling ratios corresponding 

O 
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to the employment size of the firms were applied to select the sample. The 
random number chosen did not select any firm in these categories. 

For selected services (medical, legal, educational, nonprofit 
organizations) the first step in selecting firms in this industry group 
was to choose a systematic sample with the standard sampling fractions 
from the listing described above. Since this sampling list was incomplete, 
a supplementary sample of establishments not covered by the New York State 
Unemployment Insurance Law was chosen for the following four groups: 

1 . Indepen d ent professionals . 

The yellow pages of the Rochester telephone directory* were scrutinized 
and those included in the New York State Division of Employment list were 
deleted. From the remaining list a systematic sample of 1:142 was selected. 

2 . Nonprofit organizations . 



The yellow pa^os of the Rochester telephone directory* were reviewed and 
institutions listed in the "covered” employers were eliminated. The follow- 
ing lists were used to obtain a more complete coverage of the population: 
nonprofit organizations listed by the Council of Social Agencies of Roches- 
ter, a directory of hospitals in Monroe County published by the Journal of 
the American Hospital Association, Roman Catholic parochial schools listed 
by the Diocese of Rochester, and secondary schools and colleges as 
provided by the Rochester office of the New York State Division of Employment. 

The final list was divided into two parts: employers for which some 

measure of employment size was available, and those for which employment 
size was unknown. For the former, a systematic sample corresponding to the 
established sampling ratios was used and for the latter, a sampling ratio 
of 1:50. 



5 • Government - Federal, state , and local * 

A list of agencies was compiled from various sources. As with the non- 
profit group, this list was divided into two farts: these agencies with 

known employment size and those with unknown employment size. Th» sampling 
ratios corresponding to the employment size of firms veio used for the 
establishments with known employment slz<* and a systematic sample of 1 in 
50 was used 'to select the sample for those with unknown employment size. 

4. Rubllc schools . 

From a publication of the New York State Education Department a listing 
of the public schools in hJonroe County was obtained. Ihe list included a 
measure of employment size. The regular sampling ratios were used to 
select a systematic sample. 

* The Rochester metropolitan telephone diiactory covers all of Monroe 
County and some areas outside this county. If a unit selected vv s 
outside Monroe County, it was excluded from the sample. 
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After the February 1965 survey vas carried out, a supplementary 
sample was added to the original one*. Eleven firms were reported "out of 
business” in February* They were identified under their respective major 
industry groups and a systematic sample of 11 new firms which had started 
operations after the second quarter of 1964 was selected. These firms 
were selected to correspond +0 the industry of the firms T, out of business," 
but s?nce no employment information vas available at that time, a sampling 
ratio of 1:50 corresponding to the stratum of employers with unknown 
employment size vas used. 

The sample included approximately 400 employers in Monroe County. 
These employers .'eported (in February, May, and August, 1965 ) the number of 
employees in their respective firms and described the Jobs they were seek- 
ing to fill, specifying their requirements as to occupation, experience, 
education, and sex, as well as the desirable starting date. Estimates of 
job vacancies, of* job vacancy rates, and of changes in these quantities 
were derived from these reports. 



Su mmary 

In the light of present information the sample design of a Job 
vacancy survey should include a stratification of the firms by employment 
size and type ox' industry. The specification of the strata to be used for 
designing the sample should be based upon data shoving how Job vacancies 
vary according to the characteristics of the firms and should take into 
account the fcize of the labor force area and the distribution of firms by 
strata. The strata should group films homogeneous with regard to job 
vacancies and maximize the differences between firms in separate strata. 

The NICB surveys of Monroe County used nine employment size 
strata and within each size stratum subclassified firms by type of industry. 







♦ The vacancy rute in these supplementary firms was 12.5, as cohered with 
3.?: for all employers ( Measuring Job Vacancies , p. 143). Therefore, the 
updating of samples is highly desirable for a vacancy survey. However, 
delays in the registration of new firms sometimes make it difficult to 
maintain an uj>-to-date sampling frame. 
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The strata used in this survey may or may nol, have produced the most accurate 
results for this area. Even if the strata used for the sample design were 
optimal for Monroe County, in order to apply the procedure to other areas, 
the specific characteristics of the area must be taken into consideration. 
Since the principal purpose is to make possible the designing of sample sur- 
veys to collect job vacancy statistics for differing labor force areas, the 
general features of sample design must be evaluated. The different circum- 
stances of each particular area for which a sample design is to be made 
will determine the stratification necessary. 

In order to be able to detemlne an adequate stratification, we 
shall go on to analyze the variability of the sample estimates of Monroe 
County as an example of the method employed. 
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Chapter III: MEASURES OF VARIABILITY 

When the variability of sample estimates by employment size and 
by type of industry of firms is to be analyzed, it is advisable to discuss 
the computation of the following estimates: 

a) total number of job vacancies, 

b) job vacancy rates, 

c) changes in total number of job vacancies between survey periods, and 

d) changes in job vacancy rates between survey periods* 

For each of these estimates, the standard error is used to evaluate the 
variability of the sample used in the NICB survey of Monroe County. 

However, a simpler sample design will be used to estimate the 
variance of the sample estimates. That is, the variance is computed for a. 
sample stratified by size of firm only, on the supposition that within each 
size stratum a simple random sample of firms was selected. This procedure 
simplifies computations, but leaves out of consideration the fact that firms 
v:ere classified by industry within each size stratum and that from each 
stratum a systematic sample was selected. The approxirr * tion of the variance 
gives an estimate somewhat larger than the true variance of the design. 
Therefore, if tn calculated variance is used to compute the reliability 
of the sample estimates, the results will be on the conservative side, 

Although nonsampling errors (both those increasing the sampling 
variances and those creating biases) can significantly affect results, the 
sample design used in the NICB vacancy surveys does not allow for such esti- 
mation.* The measures of variability available from the NICB surveys permit 
estimates of sampling variability only. To estimate nonsampling errors a 



* A discussion of nonsampling errors in the NICB surveys is included in 
Measuring Job Vat jncies , Chapter 7- 
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replicated sample must be used. However, the advantages of replicated 
sample designs are sometimes offset by other factors. If only two repli- 
cations are carried out, estimates of variance are quite poor; on the other 
hand, for multiple replications, each replicate must comprise a. large number 
of units; this enlarges the total sample size and significantly increases 
costs. The job vacancy surveys being carried out by the Dominion Bureau of 
Statistics in Canada use a replicated sample design. However, this is still 
an incipient project to the extent that reports giving estimates of total 
variability of vacancy estimates have not yet been published. 

It should also be mentioned that if a large percentage of sample 
firms do not respond, estimates based on the respondent firms may be biased, 
since the characteristics of firms that do respond are not necessarily the 
same as those of nonrespondent firms. In the 1 965 NICB surveys the problem 
of nonresponse was negligible, since 99 $ of the sample firms responded. 

The tables that follow specify (a) the estimates, (b) the standard 
error of these estimates, and (c) the coefficient of variation. The latter, 
the ratio of the standard error to the quantity estimated, gives a measure 
of the reliability of the estimates. For example, the coefficient of 
variation of the total number of job vacancies in February 1965 is 0.07 5 
corresponding to a standard error of 553 job vacancies. This indicates 
that if many random samples of employers had been used in the February 1965 
survey, the 95$ confidence interval for total job vacancies would include 
the true population value in 95$ of the samples. The 95$ confidence interval 
for total job vacancies in the NICB February 1965 survey is 7,9^7 plus or 
minus 1,106, i . e . , between 6,8^1 and 9>053 vacanc i es * in this example 
the analyst would infer that the sample was large enough to yield reliable 



estimates of total number of job vacancies. The same logic applies \o the 
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between job vacancy rates. The latter is defined as the ratio of job 
vacancies to the total of employed plus job vacancies, i .e . , the total 
demand for labor, satisfied and unsatisfied. 

Before designing a sample, an analyst must decide what magnitude 
of changes in job vacancies has economic significance for his particular 
purpose. For example, it might be significant to detect changes in vacan- 
cies which represent 0.5 $ of total labor demand (employment plus vacancies) 
in Monroe County. Half of one per cent of 276,000 is 1,380 job vacancies, 
and a standard error of 69O would be sufficient to obtain 95$ confidence 
ir. detecting this change. The estimate of change between Pebruary and May 
1965 may serve as an illustration - it is 829 vacancies, and the estimated 
standard error is 557; in this case, the coefficient of variation is 0.7. 
This means that the estimate of change is not reliable in terms of the 
standard error, but, as noted at the outset, such a relatively small chahge 
may be considered of little economic importance. 

A) Actual Measures of Variability for Each Survey Period 
1) Vacancies by industry 

The employment size strata and sampling fractions used for the 
selection of the sample are listed below. For most employers the employment 
size corresponds to that in the records of the New York State unemployment 
insurance system for June 30, 1964, hereafter referred to as the selection 
date . 

The employment size strata on the selection date are listed 
below. Hereafter, the letter j will refer to these strata Q = 1, 2, 3* 

-.-.9). 
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Stratum Q) 


Base Employment Size 


Sampling Ratio 


1 


0 


1:100 


2 


1-3 


1:142 


3 


4-7 


1:52 


u 


8-19 


1:28 


5 


20-49 


1:12 


6 


50-99 


1:6 


7 


100-249 


1-3 


8 


250 and over 


1:1 


9 


unknown 


1:50 



Table 1 presents the estimated total number of job vacancies, 
classified by industry for the three surveys (February, May, and August, 

1965) and subsequently will be referred to as survey 1, 2, or 3- However, in 
formula.s the survey number will be identified by the letter r (r = 1, 2, 3) . 
The industry groups defined in terms of the Standard Industrial Classification 
(S.I.C.) of the firms are listed below. The letter k will be used to identify 
an industry group (k = 1, 2 ; 3 9 . . . , 9) • 





Industry Group (k) 


S.I.C. 


1 . 


Durable manufacturing 


19, 24-25, 32-39 


2. 


Nondurable manufacturing 


20-23, 26-31 


3. 


Construction 


15-17 


4. 


Public utilities 


40-49 


5. 


Trade, retail and wholesale 


50-59 


6. 


Finance, insurance, and real estate 


60-69 


7. 


Services, excluding education 


70-81, 83-89 


8. 


Education 


82 


9. 


Government 


91-94 



The letter i will refer to an individual firm. 



let 




r 

V,. 



Vacancies on survey r of firm i in 

size stratum £ on the selection date, and in industry V 




0 For films not in industry k. 
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o 

N . : Number of firms in the population of size stratum ^ on the 

selection date. 

n° : Number of firms in the sample of size stratum J on the selection date. 



f. = Sampling fraction in the original size stratum 
At the time of the first survey some firms selected for inclusion in the sample 
were out of business. Before the second survey a supplementary sample was selected. 
Employment size information was not available for these new firms, so they vere placed 
in size stratum 9* Trese firms will be denoted as . Certain firms vhich res- 

ponded to the first survey, were oot of business or refused to answer on the Becond 
or third survey. Ifcese firms will be denoted as nj , where a: * 2, 3 . Therefore, 

* o 

the total number of lirrs in the sample in stratum j on the first survey is ^ , 
arl on the second or third survey they are , if ^ ^ 

for = 9- The corresponding estimates for tfc 2 population are N/j , for the first 
survey, and NlJ - Nfj , if J. + 9, ^ - 1 for ^ c 9 for the second and third 

surveys. 



Throughout Part A, formulas are written based on the first survey, 
estimate of totul vacancies for an industry k is: 
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The standard error of the vacancies la the square root of the variance. 
The variance of the vacancies in an industry gxx>up k is: 



Var (V ) = 2 - 

J” 






i i £ 



4 -N * \ 

( £ V ) 



1L 



Vt - 1 



( 2 ) 



To adapt the above formula for Survey 2 or Survey 3, n • should be modified by 

. - J 

adding the supplementary sample ( ^ ) } and by subtracting the firms which did not 

/ r * o 

respond on these surveys ( * : ); similarly N* should be modified; and the vacancies 

v <1 

would refer to Survey 2 or Survey 3 . 

To estimate the total number of vacancies the following comput + 

be made.' 



z 



V.; 



F' i 



where 



V. . : Numoer of vacancies on Survey r, of firm i in size stratum J 



<1 



on the selection date. 



The estimate of the variance of the total is: 



Var <V 1 ) = Z! 

4 



4 vl 






* • 
A 



K o " 1 
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Table 1. Total Number of Job Vacancies, Standard Error, and 
Coefficient of Variation, by Industry Group 



Survey Period 
and 

Industry Group 


Job 

Vacancies 

(i) 


Standard 

Error 

of 

Vacancies 

(2) 


Coefficient 
of Variation 
of Vacancies 


February 


Durable manufacturing 


2,590 


195.0 


0.075 


nondurable manufacturing 


431 


27.9 


0.065 


Construction 


850 


347.0 


0.408 


Public utilities and transportation 


408 


284.0 


0.696 


Trade, retail and wholesale 


1,004 


233.0 


0.232 


Finance, insurance, and real estate 


294 


106.0 


0.361 


Services, excluding education 


710 


162.0 


0.228 


Education, public and private 


1,320 


82.4 


0.062 


Government 


340 


43.9 


0.129 


Total 


7,947 


553-0 


0.070 


May 


Durable manufacturing 


3,418 


289.O 


0.085 


Nondurable manufacturing 


8o4 


140.0 


0 . 174 


Construction 


836 


270.0 


0.323 


Public utilities and transportation 


257 


101.0 


0.393 


Trade, retail and wholesale 


1,296 


241.0 


0.186 


Finance, insurance, and real estate 


224 


92.2 


0.412 


Services, excluding education 


856 


147.0 


0.172 


Education, public and private 


723 


64.4 


0.089 


Government 


362 


67.1 


0.185 


Total 


8,776 


469.0 


0.053 


August 


Durable manufacturing 


3,516 


312.0 


O.089 


Nondurable manufacturing 


1,057 

816 


149.0 


0.141 


Construction 


334.0 


0.409 


Public utilities and transportation 


181 


83.6 


0.462 


Trarie, retail and wholesale 


1,284 


242.0 


0.188 


Finance, insurance, and realestate 


179 


52.7 


O.294 


Services, excluding education 


792 


209.0 


0.264 


h ideation, public and private 


386 


35.5 


0.092 


Government 


357 


59.6 


0.167 


Total 


8,568 


553.0 


O.O65 



O 

ERIC rce: Based on data from all units that responded to the NICB surveys. 
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The results of applying these formulas to the Monroe County survey 
data are su mma rised in Table !• It is found that the construction industry has 
the highest standard error in two of the three surveys. Its coefficient of varia- 
tion is above 0.3 in all three surveys. The high variability of chis industry is 
probably a reflection of its seasonal nature owing to climate » Durable manufacturing 
and trade are industries with a large standard error also. This finding is relevant 
to any attempt to design an optimal sample. To obtain the greatest gains possible, 
firms in cons truct ion, trade, and durable industries are grouped in Chapter IV (deal- 
ing with optimal sample design) to form a special stratum having a higher standard 
error. 

2 ) Vacancies by size 

To measure the variability of the estimates by employment si^e of re- 
spondents, the procedure is as indicated below. The tetter m is used to identify 
the present employment size of a firm (m * 1 , 2 , 3, ..., 8). Firms ere grouped into 
the following employment sizes: 



Firms Grouped by Employment Size (m) 


Number of Employees 


1 


0-9 


2 


10-19 


5 


20-49 


4 


50-99 


5 


100-249 


6 


250-999 


7 


1,000-2,499 


8 


2,500 and over 



The letters U, r) are ^sed as defined previously. 
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The definition of the vacancy variable to be used for estimating the char- 
acteristics corresponding to employment size m is: 



w' r* 



V 

0 







Vacancies of firm i in stratum 4 on the 
selection date, and in employment size in 
at survey r_. 



\ 



0 



Firms not in group m at survey r» 



The estimate of total number of vacancies in size group m on Survey 1 is: 



0 




<. S 



(5) 



The variance of this estimate is: 



Var (V > ”' s - ) 



A 

... 7_ 



a ; 



(*)?)\ { \\ X- ^ V ' 

Lil {\-t-)\ -til 

■5 I « 



^ ™ 1 






V\ • ~ 1 

si 



( 6 ) 



To modify the above formula for Surveys 2 or 3 , the vacancies (V ^ ) correspond 

to r = 2, 3; n° and N ° are modified to include the firms added to the sample 
~ J <1 

before Survey 2, and to exclude the firms which did not respond on Surveys 2 or 3 . 

The standard error is largest for the smallest size group of 0 - 9 employ- 
ees (Table 2). Ine largest size groups of 1,000 - 2,499 employes, and of 2,500 
and over have zero sl&ndard error, since all of these firms were included in the 
sample. Firms having 250 to 999 employees on the selection date were also included 

with certainty; however, the standard error for this size class is not zero, because 

O 
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Table 2 . Total Number of Job Vacancies, Standard Error, 
and Coefficient of variation, by Employment Size 







Standard 


Coefficient 






Error 


of Variation 


Survey Period 


Job 


of 


of Vacancies 


and 


Vacancies 


Vacancies 


v 2 ) t ( 1 ) 


Employment Size 


(1) 


(2) 


(?) 


February 


1,126 


415.0 


0.369 


— v=r 


10-19 


420 


122.0 


0.290 


20-49 


722 


185.0 


0.256 


50-99 


672 


290.0 


0.432 


100-249 


627 


157.0 


0.250 


250-999 


1,273 


17.1 


0.013 


1,000-2,499 


591 


0 


0 


2,500 and over 


2,516 


0 


0 


Total 


7,947 


553.0 


0.070 


May 

0-9 


784 


246.0 


0.314 


10-19 


786 


198.0 


0.252 


20-49 


1,172 


288.0 


0.246 


50-99 


834 


195.0 


0.234 


] 00-249 


701 


184.0 


0.262 


• 50-999 


1,420 


79-2 


0.056 


1, 00-2,499 


643 


0 


0 


2,500 and over 


2,436 


0 


0 


Total 


8,776 


469.0 


0.053 


August 








0-9 


890 


349-0 


0.392 


10-19 


848 


322.0 


0.380 


20-49 


884 


246.0 


0.278 


50-99 


707 


137.0 


0.194 


100-249 


853 


167.0 


0.196 


250-999 


1,016 


37.1 


0.037 


1,000-2,499 


824 


0 


0 


2,500 and over 


2,546 


0 


0 


Total 


8,568 


553.0 


0.065 


Source: Based on data 


from all units 


that responded to the NICB 



surveys. 
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some firms which had less than 2p0 employees when the sample was selected, had more 
than 250 employees when the survey data were collected. 

3) Vacancy rate hy Industry 

The Job vacancy rate is ( 1 00 j r ) (V: Job vacancies; 

\f+ t 

E: employment)* Let k identify the industry group (k = 1, 2, 3, . 9)- The var- 

iable V ^ has already been defined. Total labor demand may nov be defined aB: 






<V ' V > 



k n. 



- ( <v 



. A +E ■ • ) Vacancies plu& employment on survey £ of 

^ ^ firm in stratum^ on the selection date, 

and in industry k. 



For firms not in industry k. 



The vacancy rate for industry k on Survey 1 is; 



no 



MX . ,kl 

V \ \oo V 



( ..c... 

V v - E 



jT, -fj 4.-. • J 



til 



( ')* 6) 



4 - C* N l<1 

z. ^ 






(7) 



To compute the variance of the vacancy rate, a first approximation formula is 
used.* The variance of the vacancy rate of industry k on survey r is: 



v ‘ r Hvfi 






\0 



o ^ 



ki 






(> C 



1*1 



-V Ar [W+E) k M 



ERIC 





)* [(' 


x [ 


V k *,(V*E) k 


v ,. 


[n/*E) kl ] 


John Wiley 


Sons, Inc., 




3 ( J 



(8) 
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where Var (V ki ) is comput'd by formula (2), 



iv, b r] . 1 1 ( i>V d i ' 

r L fc i - 



r « t j r 

J 






Var 



, (9) 



o 




To estimate the total vacancy rate on Survey 1, ve use: 



100 ( JL ) ._ i?» v 



E 



C J* i f 



* A * 

1 

j 5 ' s ->- 1 ' 

.0 



ivt'vv) 1 

I * • i 1 I 



(11) 



4 < «■* i 



Var 



The variance of the total vacancy rate on Survey 1 is estimated by: 



Mu 



r / v l ’ 




' / J V* 


V 


F.oO J_\ 


s 


| 00 JC j 


i 


L W<tJJ 




WWJ 


I 



i( v L + ^ i j 1 

(v 1 .' Rv.erM* " v*[(nt)*]’ 1 ,( 12 ) 
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Table 3* Job Vacancy Rate, Standard Error, and 
Coefficient of Variation, by Industry Group 



Survey Period 
and 

Industry Group 


Job 

Vacancy 

Rate 

100V 

V+E 

(i) 


Standard 
Error of 
Vacancy Rate 
.12) _ 


Coefficient of 
Variation of 
Vacancy Rate 

jsMi) 


February 


Durable manufacturing 


2.62 


0.172 


0.066 


Nondurable manufacturing 


1-73 


0.124 


0.072 


Construction 


6.94 


2.325 


0.335 


Public utilities and transportation 


4.09 


2.458 


0.601 


Trade, retail and wholesale 


2.31 


0.485 


0.210 


Finance, insurance, and real estate 


2.91 


0.804 


0.276 


Services, excluding education 


2.46 


0.547 


0.222 


Education, public and private 


6.09 


O .182 


0.030 


Government 


2.60 


0.282 


0.108 


Total 


3.02 


O .198 


0.066 


May 


Durable manufacturing 


3.37 


0.249 


0.074 


Nondurable manufacturing 


2.99 


0.468 


0.157 


Construction 


4.94 


1.426 


0.289 


Public utilities and transportation 


2.58 


0.852 


0.330 


Trade, retail and wholesale 


2.85 


0.458 


0.161 


Finance, insurance, and real estate 


2.31 


O .831 


0.360 


Services, excluding education 


2.56 


0.472 


0.184 


Education, public and private 


3.46 


O .176 


0.051 


Government 


2.76 


0.379 


0.137 


Total 


3.16 


O .167 


0.053 


August 


Durable manufacturing 


3.35 


0.258 


0.077 


Nondurable manuf act uring 


3.75 


0.492 


O .131 


Construction 


4.72 


1.822 


O .386 


Public utilities and transportation 


1.80 


0.752 


0.4l8 


Trade, retail and wholesale 


2.73 


0.440 


0.161 


Finance, insurance, anu real estate 


1.66 


0.446 


0.269 


Services, excluding education 


2.39 


O .625 


0.262 


Education, public and private 


1-82 


0.103 


0.057 


Government 


2.49 


0.359 


0.144 


Total 


2.98 


0.187 


O.O 63 



Source: Based on data from all units that responded to the NICB surveys. 
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where Yar V 1 is computed using formula ih), 




o 




, (13) 



O 




The standard error of the vacancy rate (Table 5) is largest for the construction 
industry in two of the three surveys, as it vaa for the estimate of total Job vacancies! 
The coefficient of variation is higher for firms in the construction, public utilities, 
and trade industries than for firms in other industries. The coefficient of varia- 
tion for the total job vacancy rate \ariea between 0.05 and 0,07. 

4) Vacancy rate by size 

Table 4 gives the job vacancy rate and the estimated standard error 
by employment size of firms, The estimation procedure is Bimilar to the one 
described in Table 3, except that firms are classified by the employment size 
groups used in fable 2. That is, instead of classifying >>y industry groups (k * 

1, 2, 3, ... 9 ), employment sizes, designated by variable m (m ■ 1, 2, 3, ,,*,8), are 
used to claBBify firms. 

The coefficient of variation is largest for the smallest firms (0-9 employ- 
ees), except for Survey 1 in which the firms with 50-99 employees had a larger 
coefficient of variation. Firms with 1,000 employees or more again had zero 

standard errors, because all firm* in the population were included in th^ sample. 

O 



Table 4. Job Vacancy Rate, Standard Error > 
and Coefficient of Variation, by Employment Size 



Survey Period 
and 

Employment Size 


Job Vacancy 
Rate 
100V 
V+E 

. u) 


Standard 
Error of 
Vacancy Rate 
(2) 


Coefficient of 
Variation of 
Vacancy Rate 


February 


0-9 


3-66 


1.266 


0.346 


10-19 


2. Cl 


O.699 


0.249 


20-1+9 


3-56 


0.806 


0.226 


50-99 


4.13 


1.524 


0.369 


100-21+9 


2 i9 


0.544 


0.195 


250-999 


2.34 


0.045 


0.016 


1,000-2,499 


2.0C 


0 


0 


2,500 and over 


2 . n ) 


0 


0 


Total 


3-U2 


0.198 


0.066 


Kay 


0-9 


2.43 


0.743 


O.306 


10-19 


4.47 


0.993 


0.222 


20-49 


5-64 


1.032 


0.183 


50-99 


3.89 


1.104 


0.284 


100-249 


2.53 


O.58O 


0.229 


250-999 


3-01 


0.101 


0.034 


1,000-2,499 


2.51 


0 


0 


2,500 and over 


2.86 


0 


0 


Tot al 


3.16 


0.167 


0.053 


Aurust 


' 0-9 


2.12 


1.028 


0 78 


10-19 


4.80 


1.712 


0._>57 


20-49 


4.00 


0.911 


0.228 


50-99 


3-38 


0.777 


0.230 


100-249 


3.03 


0.493 


0.163 


250-999 


2. 20 


0.051 


0.023 


1,000 2,49? 


3-01 


0 


0 


2,500 and over 


2.76 


0 


0 


Total 


2.98 


0.187 


0.063 



Source: 




Based on data from all units that responded to the NICB surveys 
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B) Measures of Variabilit y for Changes Between Survey Periods 

Tables 5} 6, 7# and 8 axe baaed on the 393 sample firms vhlch responded 
to all three surveys. The firms for #hich data were available for only one or two 
surveys wre excluded. 

1) Changes in vacancies by industry 

In Table 5 firms are classified into the same industry groups ased in 
Tables 1 and 3, and ~ize groups have been collapsed. Subscript k is used to identify 
these industry groups (k *= 1, 2, 3, . ..,9). In estimating changes, two survey 
periods will bo compared. Ifcese periods are labeled as r 1 and where 

r 1 ^ r z and « 1,2, r, ~ 2,3. 

The absolute value of the difference in vacancies is: 

| v kri - v 1 " -1 ! , 

kr 

where V ' and V Ul are estimated by formula (1). 

The variance of the difference is estimated as follows: 



Var(V , ' r '-V kr -) s ( V 1 '■‘M.r (V kr ‘)--, 



( 15 ) 



where Vax (V ^ ) and Vax (V kr *) are estimated with formula (2). A firm in 
industry k in survey fr t , will still be in industry k in Burvey r • To estimate 
the covariance term it may be recalled that: 



k^i 





Vacancies in survey r of firms in industry k. 



0 For firms not in industry k. 

k 
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Table 5, Changes in Job Vacancies, Standard Error, 

and Coefficient of Variation, by Industry Group 



Survey Period 

and « 

Indust i"y Group 


Absolute 
Value of 
Change in 
Job Vacancies 

a) 


Standard 
Error of 
Change 

in Vacancies 

( 2 ) 


Coefficient 
of Variation 
of Change 
in Vacancies 

(W 

( 3 ) 


February - May 


Durable manufacturing 


728 


164 


0 . 2 b 


Nondurable manufacturing 


249 


81 


0.33 


Construction 


114 


324 


2.84 


Public utilities and transportation 


151 


299 


1.98 


Trade, retail and wholesale 


292 


247 


0.83 


Finance, insurance, and real estate 


70 


48 


0.69 


Services, excluding education 


146 


199 


1.36 


Education 


597 


59 


0.10 


Government 


22 


56 


2.55 


Total 


505 


577 


1.14 


May - August 


Durable manufacturing 


148 


211 


1.43 


Nondurable manufacturing 


377 


85 


0.23 


Construction 


270 


241 


O .89 


Public utilities and transportation 


76 


58 


0.76 


Trade, retail and wholesale 


12 


206 


17.17 


Finance, insurance, and real estate 


45 


66 


1.47 


Services, excluding education 


64 


201 


3-14 


Education 


337 


30 


0.09 


Government 


5 


37 


7.40 


Total 


284 


449 


1.58 


February - August 


Durable manufacturing 


876 


237 


0.27 


Nondurable manufacturing 


626 


l4l 


0.23 


Construction 


384 


366 


0.95 


Public Utilities and transportation 


227 


296 


1.30 


Trade, retail and wholesale 


280 


219 


0.78 


Finance, insurance, and real estate 


115 


83 


0.72 


Services, excluding education 


82 


"!6l 


3.18 


Education 


934 


66 


0.07 


Government 


17 


72 


4.24 


Total 


221 


638 


2.98 




Based on the 393 uni + s that responded to ail 1 t.. e NICE surveys. 
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A 




Vacancies in survey £2 of firms in industry k. 



0 For liras not in industry k. 



Since ve have limited the analyst b to firms which responded to all three 
surveys : 

*=■ N^ 2 - = N* - nJ e jj- > where N* are the firms in size stratum j of 

0 0 0 j J j “ 

the population on the selection date, and Nj corresponds to tl ' ^irtae for which 

data were not available on all three surveys . N* is estimated as • The 

population is reduced by the number of firms which did not respond to all surveys. 

r V c 9 

The firms in the sample are: n^ « n «= *= n^ . 

nj 1 nj since the firms which did not respond to all surveys (n^ ) are omitted. 
Then the covariance term is: 

cov (v 1 ^, /■*) . £[2L(-Sj{ 

i* I L n j J ■ 




The absolute value of the difference of the total number of vacancies 
is estimated as below: 

|v r ' - V r *| 

where V*' 80d V** are computed using formula (5)* 

The variance of the difference in the total number of vacancies is 
computed by: 



VarO^' -V rA ) = Yar (V^’ ) + Var (V* 2 -) - 2 Cot (V*', V 1 *-) , (17) 

where Var (V** 1 ) end Var (V ri ) are estimated by formula (4). The covariance is 

?v. u >_ <M)M) 



calculated by: 
Cov 



„ ,,V , £ 

- t gj-(l - (,)] s --- n ..v ^ 

J - 1 ^ * J 



(18) 
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where 

: Number of vacancies in survey r , of firm i_ in size stratum J^ on 

the selection date. ~~ 

: Number of vacancies in survey £p of firm _i in size stratum J^ on the 

selection date. 

The standard error of the changes in total Job vacancies is larger than 
the estimated size of this change and this was the case for about half of the 
industry groups* Therefore, the NICB sample of Monroe County is not big enough 
to pinpoint the small changes in Job vacancies which occurred between the three 
1965 surveys, but these changes may be considered economically insignificant. 
Table 5 includes estimates of changes that occurred in three-month periods and 
in a six-month period. 

2) Changes in vacancies by si2e 

Table 6 gives estimates changes of vacancies by employment size of 
firms* The 393 firms for which data for the three surveys are available are 
grouped to form the employment size classification used, denoted by the letter 
£ (s c 2, •••> 5)i 



Employment Size of Firm { s ) Number of Employees 

1 0-9 employees in all three surveys 

2 10-49 employees in all three surveys 

3 50-2^9 employees in all three surveys 

4 250 or more employees in all three surveys 

5 Firms which do not correspond to groups 1-4 
aB defined above. This group includes 39 
firms which shift employment size groupB be- 
tween survey periods 
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Table 6. Changes In Job Vacancies; Standard Error, 

and Coefficient of Variation, by Employment Size 



Survey Period 
and 

Employment Size 






Absolute 
Value of 
Change in 
Job Vacancies 


Standard 
Error of 
Change 
in Vacancies 

(2) 


Coefficient 
of Variation 
of Change 
in Vacancies 

W 


February - May 












Firms that remain 


in same employment 


size 








0-9 






298 


387.00 


1.30 


10-49 






338 


198.00 


0.59 


50-249 






116 


336.00 


2.90 


250 and over 






175 


58.80 


0.34 


Firms that change 


employment size 




174 


171.00 


0.98 


Tot al 






505 


577.00 


1.14 


May-August 












Firms that remain 


in same employment 


size 








0-9 






66 


215.00 


3.26 


10-49 






112 


210.00 


1.88 


50-249 






99 


226.00 


2.28 


250 and over 






121 


61.20 


0.51 


Firms that change 


employment size 




110 


237.00 


2-15 


Total 






284 


449.00 


1.58 


February - August 












Firms that remain 


in same employment 


size 








0-9 






364 


375.00 


1.03 


10-49 






450 


320.00 


0.71 


50-249 






17 


324.00 


19.O6 


250 and. over 






54 


2.45 


0.05 


Finns that change 


employment size 




64 


288.00 


4.50 


Total 






221 


658.OO 


2.98 



Source: Based on the 393 units that responded to all three NICB surveys. 
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The vacancies of employment size s are defined as follows: 
r, 

i Vji Vacancies on survey r f of firm i in size stratum ^ on the 
selection date, and in size group on survey r ( . 

0 For firms not in size group s on survey r,. 




Vacancies on survey r z of firm i in size stratum on the 
selection date, and in size group s on survey r 
For firms not in size group s on survey r v 



If a firm is in a particular size group £ on survey r f , it will be in 
the same size group on survey r L . 

The absolute value of the difference of vacancies between two survey 
periods is: 



I v sr ' - v 3r * I 



where V Sr ' = Z.T fi V*' 

1 J V ' 

The variance of the difference is: 



(19) 

( 20 ) 



Var (V 8 * 1 ' - V 81 "*-) = Var V ST ' + Var V® r i - 2 Cov (V 81 "' , V 81 "*-) 



where Var V 81 " 1 ■ 

TT Lr. , v J *J 



"j- 



( 21 ) 



( 22 ) 



Var(V srj -) is computed with an equation similar to formula (22), but using variable 



V» 4 . The covariance term is estimated as follows:.,, 
Ji r> 



Cov (V Sr ' , V Sr M . 



f#M> 



y-' L j 






, avrx tw) 



h j~ 



(25) 



Of the 39 firms in group 5j 21 firms shift between size group 1 and 2; seven films 

shift between size group 2 and 3; seven shift between size group 3 and three 

c% 

Lft between size group 1 and 3, and one fine shifts from group 1, to 2, and than 
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to 3* Some of the*e firms may have seasonal fluctuations in their employment; 
others may be expanding or shrinking their employment. 

Although the following results may have little economic importance, the 
standard error of the difference in vacancies given in Table 6 is of the same 
order of magnitude as the absolute value of the difference in vacancies for all 
size groups, except for the firms with 250 employees or more; therefore, the NICB 
sample survey is not geared to detect accurately small changes in vacancies 
which actually occurred. 

3) Changes in v acancy rate by industry 

Table 7 gives estimates of changes in the job vacancy rate and standard 
error of this estimate for the total and for industry groups. The nine industry 
groups used in Tables 1, 3j and 5 (denoted by k = 1,2,3, ... ,9) are again analyzed 
there . 

To estimate the absolute value of the difference in the vacancy rate for 
industry groups, the vacancy rate of the firms in industry k on survey r^and on 
survey r^had to be calculated. These estimates are based on the 393 firms vhich 
responded to all three surveys. Formula (7) is used to estimate the job vacancy 
rate. Then the desired estimate of change can be represented by: 




The variance of this estimate is: 



Var 



Ksr- : Har] - - H&r] * - wm 

- 2 Cov L 100 (vTE) kr ' > Wv+eT 1 ] 



( 24 ) 





\ ^r i 




r , „ Ml 


where Var 


1 w (ke) _ 


and Var 


100 (v+e) 



are estimated by formula (8). 
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The covariance term is estimated by the following first approximation formula 
(see Kish, p. 210): 



Cov 



HiT- 10 °(™V‘] ■ — 



(v+e)®*’ 1 (V+E) 1 ^ \ v 1 ^. V^z 



+ Covfrv+E)^ 1 .(V+E) 10 ^ _ Cov[y kr| , (V^E)^] _ Cov[v kr > i (V-t-E)^'] ( , (25) 

(V+E) 1 ^. (V+E) 1 ^* V^- (V+E) kr Z. ^(V+E)^* / 



kr, 

(Vji + E Ji) 



where Cov (V^** 1 , V^ r z) is estimated by formula (16). 

Vacancies plus employment in industry k is defined as follows: 

For firms in industry k on survey r ^ 

For firms not in industry k on survey r j . 

Eji ) For firms in industry k on survey r v 

For firms not in industry k on survey r ^ 

Then the covariance is: 



kr. 



( v ji + e ji) 1 “ 



i ( v ji + E ji^ 

:*• 



Cov 

and 

Cov 



[(V+E)*^ 1 , (»*E) kr ‘-l .£K(' -til 

j,l j J n j 



,^ !yy 

^ (26) 
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[V^.,(V + E)^] * ~ l ~ * — 

Cov [/^(V+E) 1 ^ 1 ] is computed with a formula similar to (ZJ), but using 
instead of Vj^i, and (Vj^ + Eji)^ 1 instead of {Vj* + Eji) kl \ 

The difference of the, total vacancy rate is: 

r i r i 

I 100 • 100 (y^) I * 



• (27) 
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Table 7- - Changes in the Job Vacancy Rate, Standard. Error 

and Coefficient of Variation, by Industry Group 



Survey Period 
and 

Industry Group 


Absolute 
Value of 
Change 
in Job 

Vacancy Rate 
(i) 


Standard 
Error of 
Change in 
Vacancy Pate 

( 2 ) 


Coefficient of 
Variation of 
Change in 
Vacancy Rate 

(2HU 

m 


February - May 


Durable manufacturing 


0.68 


0.16 


0.23 


Nondurable manufacturing 


0.90 


0.32 


0.35 


Construction 


2.54 


2.42 


0.95 


Public utilities and transportation 


1.51 


2.83 


1.87 


Trade, retail and wholesale 


0.55 


0.54 


0.98 


Finance, insurance, and real estate 


0.60 


0-37 


0.62 


Services, excluding education 


0.12 


0.71 


5.95 


Educ at i on 


2.63 


0.26 


0.10 


Government 


0.16 


0.42 


2.61 


Total 


0.06 


0.22 


3.67 


May - August 


Durable manufacturing 


C .003 


0.20 


67.33 


N o n aur ab le r. anuf ac tur i ng 


1.15 


0.26 


0.23 


Construction 


1.70 


1-39 


0.82 


Public utilities and transportation 


O .78 


0.56 


0.72 


Trade, retail and wholesale 


0.12 


0.44 


3.69 


Finance, insurance, and real estate 


O .65 


0. 66 


1.02 


Services, excluding education 


0.18 


0.6l 


3.39 


Education 


1.64 


0.08 


0.05 


Government 


0.27 


0.30 


1.09 


Total 


0.22 


0.16 : 


0.73 



February - August 



Durable manufacturing 


0.68 


0.22 


0.32 


Nondurable manufacturing 


2.05 


0.46 


0.23 


Construction 


4.24 


2.6l 


0.62 


Public utilities and transportation 


2.29 


2-75 


1.20 


Trade, retail and wholesale 


0.43 


0.46 


1.07 


Finance, insurance, and real estate 


1.25 


0.72 


0.57 


Services, excluding education 


0.06 


0.84 


13.98 


Education 


4.27 


0.22 


0.05 


Government 


0.11 


0.54 


4.88 


Total 


0.16 


0.24 


1.50 



Source: Based on the 393 units that responded to all three NICB surveys. 
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where the vacancy rate is estimated by formula (11). The variance of this 
estimate is: 



Var 



100 (ra ) r 1 ■ v " [-fey] ♦ MvJbT 1 ] 

- 2 »» [ 1M (raT'. ""(toT 4 ] • <*» 

[lO°(v+Ki J an d of Var *] are derived from formula (12), 



Estimates of Var 



iWJLV', lool^-Y 1 } « 10,000 flft /ooy ttLj&l 
\ V+E / W+E; J (V+E) r i (V+E) 1 " 2 - 1 v 1 ’* V 1 * 2 

+ Covt/V +E)* 1 , (V+E)* 2 ] _ Cov fv r ‘ , (V+E) r ^1 _ Covjv^ (V+E)* 1 ] 1 
(V+E) r i (V+E) r2 - V r - (V+E) r t V* 2 - (V+E) r ‘ j 

where Cov (V* 1 , V* 2 ) is estimated by formula (18), 

Cov[(V+E) r ',(V+E) r2 ] = 

i r » 1 1 (v- , t.j’fv- , e j'_ life * 

s r[t(i-fl 



(29) 



and 



Cov [/' , (V+E) ri ] 



— 

j-' L J J J 



(50) 



.(51) 



Likewise, Cov [vS (V+E) r '] is cotnputed by a formula similar to (31 ) where 
VjJ is substituted by Vj£ and (V^ + Bj 1 ) r 2 is substituted by (V^ + E J1 ) r '. 

The estimates of changes of the job vacancy rate obtained are too small 
tn b# measured accurately with the NICB aaaple, since the coefficient of variation 
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is greater than 1 for many industry groups. For the two three-month changes 
the coefficients of variation of the total are 0.71 and 3*63, and for the one 
six-month change it is 1.48. 

4) Changes in vacancy rate by size 

Table 8 presents the changes in vacancy rates for the employment siz* 



where 



and 



100 



( V + E 



in Table ( 
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.,5). The absolute value 
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(52) 



(55) 



,>"> ■ { 



* V 1 



Vacancies plus employment in survey r n 



of firm i in size stratum ^ on the selec- 
tion date, and in employment size group s. 
0 For firms not in t’ize group e on survey r^. 

The vacancy rate for size s in survey £2 is defined in a similar fashion, but with 
reference to survey r? . 

The variance of the difference of the vacancy rate is estimated by a 
formula similar to (24), but with reference to size groups s (s ■= 1,2,3, 4, 5) 
instead of industry groups k. The estimated variance is a first approximation. 

In Table 8 it should be noted that except for the films with 250 employees 
or more in all three surveys, the estimated standard error is of the same order of 
magnitude as the absolute value of the difference of the vacancy rate. 
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Table 8. Changes in the Job Vacancy Rate, Standard Error, 

and Coefficient of Variation, by Employment Size 



Survey Period 
and 

Employment Size 






Absolute 
Value of 
Change 
in Job 

Vacancy Rate 

a) 


Standard 
Error of 
Change in 
Vacancy Bate 

(2) 


Coefficient of 
Variation of 
Change in 
Vacancy Rate 

Mi r~ 


February - May 












Films that remain 


in same employment 


size 








0-9 






1.19 


1 . 4 o 


1.18 


10-49 






0.97 


0.59 


0.61 


50-249 






0.12 


O.92 


7.67 


250 and over 






0.12 


o.o 4 


0.33 


Firms that change 


employment size 




0.79 


1-35 


1.71 


Total 






0.06 


0.22 


3.67 


May - August 












Firms that remain 


in same employment 


size 








0-9 






0.26 


0.75 


2.88 


10-49 






0.13 


0.67 


5.15 


50-249 






0.39 


O.56 


1.44 


250 and over 






0.19 


0.04 


0.21 


Firms that change 


employment size 




0.66 


1.06 


1.61 


Total 






0.22 


0.16 


0.73 


February - August 












Firms that remain 


in same employment 


size 








0-9 






1.45 


1-35 


0.93 


10-49 






1.10 


0.96 


0.87 


50-249 






0.27 


0.83 


3.07 


250 and over 






0.07 


0.001 


0.01 


Firms that change 


employment size 




1 -45 


1.80 


1.24 


Total 






0.16 


0.24 


1.50 



Source: Based on the 393 units that responded to all three N 1 CB surveys. 
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Summary 



General formulas were developed for the computation of estimates 
of total Job vacancies, Job vacancy rates, and changes in these quantities 
and their variances. Data from the NICB surveys were employed to illus- 
trate the use of the general formulas. 

The estimates of the standard error of the total vary from survey 
to survey. The largest estimate of the variability will be used to summar- 
ize the results, since it represents the most conservative estimate of 
reliability. 

The coefficient of variation of estimated total Job vacancies in 
February 1965 (Survey 1 ) is 0.07. The analyst may consider that total Job 
vacancies should be estimated with a coefficient of variation of at most 
0.05. This target was not achieved in the results of the 1965 NICB surveys. 
The variability of the estimates for industry groups and employment size of 
firms is important, since these estimates can be used as a guide to deter- 
mine the best sample design. Three industries with a large standard error 
were found to be durable manufacturing, construction, and trade (retail 
and wholesale). However, these results may in part reflect the distribution 
of employment size of firms by industry. In the 1965 NICB surveys all firms 
with employment size of 250 or more on the selection date were included in 
the sample with certainty. These firms, therefore, did not contribute to 
the estimate of the standard error. The greater the percentage of large 
firms (more than 250 employees) in an industry, the smaller the estimated 
standard error of the industry. In the analysis of the standard error of 
firms classified by employment size this phenomenon is observed clearly. 
Firms with 1,000 employees or more have zero standard error. Job vacancies 
of firms with 250 to 999 employees have a relatively sma '.1 standard error, 
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which results from firms that had fever than 250 employees on the selection 
date, hut had more than 250 employees on the survey date. The employment 
size of firms with the largest standard error was that of those with fewer 
than 10 employees on the survey date. 

To be able to measure accurately very small changes in job vacan- 
cies, very large samples are needed. When a sample is being designeu, the 
order of magnitude of the changes that represent an important economic fact 
should be determined and the sample designed accordingly. For example, an 
area like Monroe County had a labor demand of about 276,000 in 1965 . The 
standard error of three -mon:;h changes in vacancies of 577 end 449 job vacan- 
cies (Table 5) would measure changes of 0.4$ to 0.3$ of labor demand with 
95$ confidence. The observed change in vacancies was 829 between the dates 
of the February and May surveys, and 208 between the May and the August 
surveys. The former represented about 0.5$ of labor demand (E+V), while 
the latter was less than 0.1$ of labor demand. A much larger sample than 
the one used would be needed to measure such small changes accurately. 
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Chapter IV: A PROPOSED OPTIMAL SAMPLE DESIGN 



For an optimal stratified sample design the sample sizes in each 
stratum are chosen so as to minimize the cost for a given variance, or, 
alternatively, tc minimize the variance for a given cost. The application 
of these criteria to job \ncancy surveys is developed in this chapter and 
illustrated by references to the Rochester area survey data. A reminder, 
however, is in order. A sample survey for job vacancy statistics has as 
its objective the obtaining of estimates of the total number of job vacan- 
cies and of job vacancy rates at certain points in time, as well as of 
estimates of changes in both between survey periods. An optimal sample 
design for one type of these statistics may or may not be optimal for 
others . 

A) Se lection of Strata for Optimal Allocation 

In Chapter II, three considerations for choosing strata were 
given: average size, variability, and cost. Significant differences in 

average number and in variability of the number of job vacancies not off- 
set by proportional differences in costs make stratif ication worthwhile. 
Specifically, it is the ratio of the standard deviation (of number of 
vacancies, of vacancy rate, of change in number, or of change in rate) to 
the square root of the cost per firm that is examined in choosing strata, 
together with the average value of the vacancy measure. 

Owing to the nature of the lists from which job vacancy samples 
are drawn, the possible stratifying characteristics are restricted to 
industry and size of firm. We have chosen the following employment size 
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groups for analysis, using the considerations mentioned above and the 
estimates of variability and cost in Tables 2 and 9* 



Size 

Group 


Number of employees of Firm 
(on selection date) 


i 


7 or fewer (or of unknown size 


2 


8 to 49 


3 


50 to 249 


k 


250 to 499 


5 


500 to 999 


6 


1,000 to 2,499 


7 


2,500 or more 



As pointed out in Chapter III, the variability of vacancies in 
durable manufacturing, construction, and trade is higher than in the 
other industries examined (Table l). The cost estimates (Table 9) do not 
offset this difference, so we have chosen the following industry classifi- 
cation. 



Industry 

Group Industry of Firm 



A Durable manufacturing, construction, and trade 

B Nondurable manufacturing, public utilities, finance, 

services, ar.d government 



These classifications produce 14 strata, as each size group is 
divided into two industry groups. 

B ) Methods for Obtaining an Optimal Sample Design 

The purpose of designing optimal samples is the utilization of 
the resources available in the most efficient manner. Two alternative 
approaches are used to select optimal samples: 

(a) To minimize the cost when the variance of the sample estimates 
is chosen in advance. 

(b) To minimize the variance of the sample estimates when the cost 
is chosen in advance. 

ERJC 
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Regardless of the criterion used, the optimal sample size in a stratum is 



e 






Sc 



= n — ■ 



JEL 



, H S «. 
E ( JL$) 

g=i v ssr' 



(i) 



where n 



g 



N 



g 



g 



g 



Number of firms in stratum g for optimal allocation. 

Total number of firms in the sample, (n will be determined 
to satisfy either a predetermined variance or a fixed given 
cost. ) 



Number of firms in the population in stratum g. 

Cost per firm in stratum g. 

Element standard error in stratum g. 

To determine the total sample size, the two criteria for obtain- 
ing an optimal sample must be considered separately. If a sample is 
designed to meet a given total cost, 



14 , 

c = Vb ' 



( 2 ) 



by substituting the optimal value for n* free formula (l) in this coat 

g 

function, the equation for the total sample size, n, would become the 
following: 



0 
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* Cochran, p. 96. 
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Similarly, if a sample is designed to give a specified variance, 
V, then ng from formula (l) must be substituted in the following formula: 



14 

V = £ N (N 



g“l 



g' g 



S 2 
1 \ b g 

O -4 

8 n g 



<*) 



In this case the formula for the total sample size would result as shown: 



n - 



, 14 -v , 14 N S . 

( S NS -JcT) ( £ ) 

g-=l 6 g S ' S-l N^g ^ 

- 14 r 

v + >: n_s 



(5) 



g=l 



g g 



To compute an optimal sample size, formula (l) also requires 

* 

estimates of c g , the cost per firm in stratum g. The total cost of an 
interview survey for collecting joV vacancy data is subdivided into costs 
assumed to be constant for all firms and costs considered proportionate 
to the number of vacancies in the firms. The NICB survey requested liras 
to describe requirements for each vacancy under active recruitment on the 
survey reference date. Vacancy specifications were coded according to the 
Dictionary of Occupational Titles .** This required repeated contacts with 
the firm by trained personnel to obtain complete data. Data for firms 
with a large number of vacancies or vague specifications were consequently 



* The estimate of total cost is based on the data presented in Measuring 
Job Vacancie s, Table 5.1, p. 77. 

** U.S. Bureau of Employment Security, Dictionary of Occupational Titles, 
Vols . I and II, Second Edition, 19^9. 
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more expensive to compile than those for small firms or for those with welu. 
defined requirements. The survey cost per firm in a given stratum was esti- 
mated as the sum of two components: (a) an average per firm of those costs 

that do not vary among firms, and (b) a cost proportionate to the average 
number of vacancies in each stratum. 

The data on cost per firm used for the optimal design of the 
sample are given in Table 9 > columns (ll) and (12). The range of cost per 
firm varies between $4.66 for firms in Size 1, Industry Group B, and $317*94 
for firms in Size 1 , Industry Group A. The estimated cost per firm is used 
in formula (1 ) to compute the optimal sample design. 

Formula (l) also requires estimates of S g , the element standard 
error of the strata selected for the optimal allocation. Since the NICB 
sample included all firms with 250 or more employees on the selection date, 
the population value of the element standard error can be obtained in the 
strata corresponding to these firms: 




( 6 ) 



where V , ; Number of vacancies of firm i in stratum g. 
gi 

For the strata corresponding to firms with fewer than 250 employ- 
ees, two or more strata originally included in the sample were collapsed to 
arrive at an optimal stratum* If two strata, for example, denoted by gl 
and g2, are collapsed to form stratum g, on unbiased and consistent estimate 
of the element variance can be tahen as*: 



Tne proof that formula (7) is unbiased and consistent js given in 
Appendix A. 
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•where N 



o 

ERsLC 



gi 



N 



g2 



N 



Q 

V 

n g2 



Number of firms in the population in stratum gl. 
Number of firms in the population in stratum g2. 

N g] + V 



Number of firms in the cample in stratum gl . 

Number of firms in the sample in stratum g2. 

Formula (7) assumes that a simple random sample is chosen from 
each stratum separately, then later combined to form one stratum. This 
assumption is an approximation to the sample chosen for the NICB surveys, 
since within each employment-size stratum a systematic sample of firms 
ordered by industry was selected. The element standard error for the 
estimation of total job vacancies is shown In Table 9, columns (l) - (6). 

To arrive at an estimate of the optimal sample design for changes 
in total number of vacancies in formulas (6) and (7) given above, a substi- 
tution may be made for the number of vacancies in a given survey (V ) by 

gi 
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the difference between vacancies in any two survey periods, where: 



12 



6i 



f = vh - v: 



Bi gi 



(6) 



and V . : Number of vacancies in Survey Period 1 of firm i in stratum g. 

: Number of vacancies in Survey Period 2 of firm i in stratum g. 

The element standard error for the estimation of changes in total job 

vacancies is also given in Table 9* columns (7) - (10). 

A first approximation formula to be used for the estimation of 

the element standard error for optimal allocation corresponding to the job 

100 V . * 

vacancy rate ( ) is as follows : 



.'VY 

vV 



loo -Yr 0 ? , r v i 2 ,.?> 4* v *] s , ^ % , 0 , 

WET . i c-'v LTvwJ s (v*x) " "L'(v-TLp-j s ^(v+£)y (9) 



r ioo 

U 



v:\ere V 

(V+E) 



g 

i (V+E) g 

! [V,(V + E)3g 



Estimated total vacancies. 

Estimated total vacancies plus employment. 

Element variance for vacancies in stratum g. 

Element variance for vacancies plus employment in 
stratum g. 

Element covariance between vacancies and vacancies 
plus employment in stratum g. 



In the strata corresponding to firms with 250 employees or more, 
where the sampling fraction is taken as one, the element covariance is: 



* Cochran, p. 175* 

O 
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( 10 ) 



N 



N. 



'(V, (WE)] 



N s 






If 



8 



N g - 1 



where (V+E) gi : Vacancies plus employment of firm i in stratum g. 

The optimal strata of firruB with fever than 250 employees were 
formed by combining two or more of the originally selected strata. When 
two or more strata are to be combined, an unbiased and consistent estimate 
of the element covariance is : 




The estimate of the element standard error for the Job vacancy 
rate is given in Table 10, columns (l) - (6). To obtain optimal sample 
sizes, Sg should be substituted into formula (l)> 

* The proof that formula (ll) iB unbiased and consistent is given in 
Appendix A. 



IV- 10 




o w fnj j so 

vq oo oj us jm o <-* 

r) lAH fOOJ SrJ 

§ Q CM -4 US 0> .4 
O Q H H Q VO 

ocooqo 
o o o o o o o’ 

O <^SQ ONff\Q 

c- on cn o co c> 

HOHHMS4 

§ <— I <— f CO Lf\ CM 0\ 

888800 

o o o o o o o 

IS\J$ H CO 4 O O 
03 CS 00 0\C0 i-h ir\ 
o 00 On 5 OS t- -4 
o O H fOSuMA 

8080880 

o’ o o o o o o 

VQ os 00 o C\ CM O 

§ Q CM -4 CO uS C\ 

.888880 

o o o o o o 0 



18 



Os 00 r-: co o 

_ -4 O CM -4 M3 

us oo 5\0\0 'O 



<5 o o <5 o O O 

d o o o d d o 



00 vn n c\oo ro o 



o o O o o o o 



CM V0 S- CM t"- t"- CO 
O0 C- -4 in (\l on S 
O -4- N- O 00 -4 
- J CO C J 



y 

i 



0000000 



IASS44CO O 



OOOOOOO 



§ 



C- CO 00 0Q CM CM C- 
CN CM COCO O CO cs 

§ ,4 03 -4 f- CM 

o—icos-O'^ts- 

0088880 

o o o o o’ Q o 

-4 O VO VQ-4 O 
U*\ CO A co l/s ss 
vo co oO cs ^ Cn 
o cm -4 -4- -4 

8088800 

o o o o o d o 

f— CM vn 1 

CO V0 -4 ( 

*-u cm ir\v_ __ 

§ 0 -4 so CM ron- 

o O O ^ ^ 1 

o o o o o 

ooooooo 




B| 

s | 

O P 

d 'h 



■O £ 

£ 8 



4 ^SvflSO Q 
us -4 o 4 CV S cc 
4 (S S 4 US US — i 

§ 6 rH CM MS-cr S- 

.888880 

o o o o o o o 



C 3 

4) T) 

e S 



c 4 

^4 

1 ’ r 



t" C\ C> 

-4 -4 „ . 
CM 44 



HI 



* ^ 

I 1 0 






.4, 

§4; 

i; P 



G 7 



IV- 11 



To calculate the optical sample allocation for changes in the job 
vacancy rate, an estimate is required of the element variance for changes 
in the job ’vacancy rate. This estimate is based on the finns for which 
data from all three survey periods are available. The estimate of the 
variance for changes in the job vacancy rate is : 



(s' 2 ) + (s' 2 ) 

g 1 g 2 



2 S 



[Sl>8 2 ] 



( 12 ) 



where (Sg )i and (Sg ) 2 are determined by using formula (9) and represent 
estimates of the element variance in Survey Periods 1 and 2. 

The element covariance between the two survey periods is computed by using 



the following first approximation : 









ioo r 

M,‘ ! - 



100 



.]{ 



V, 



' ! VV ] 



'i r s 



s f(WB) gl ,(\«) g2 ] - TW2T, S (v e2 ,(v + E) gl j 
- ivfgr* (V gl ,(V+E) g2 JJ V 



where 



v 2 

(V+E) x 



Totol estimated vacancies in Survey 1, 

Total estimated vacancies in Survey 2. 

Tota" estimated vacancies plus employment in 
Survey 1. 



(v+e) 2 



Total estimated vacancies plus employment in 
Survey 2. 



+ Kish, p* 210* 
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( V gl ,V g2^ 

S C(V+E) g i,(V+E) g2 ] 

S C V g2’ (V+E W 



s [v gl , (v+e) k2 ] 



y g2J 



Element covBriance between vacancies in Surveys 
1 and 2 in stratum g. 

Element covariance between vacancies plus em- 
ployment in Surveys 1 and 2 in stratum g. 

Element covariance between vacancies in Survey 2 
and vacancies plus employment in Survey 1 in 
stratum g. 

Element covariance between vacancies in Survey 1 
and vacancies plus employment in Survey 2 in 
stratum g. 



The element covariances for strata of firms with 250 or more em- 
ployees are estimated using fo^ulas similar to (10). For firms with fewer 
than 250 employees — in which the optimal strata were derived by collapsing 
two or more original strata — the element covariance can be calculated by 
formulas similar to (ll), In both cases, appropriate variables must be 
used. For example, to estimate the element covariance between vacancies in 
Survey 1 and Survey 2, the variables and should be used. The esti- 
mates of the element standard error of changes in the vacancy rate are 
given in Table 10, columns ( 7 ) - (12). 

In the next section all these formulas are applied to data ob- 
tained in the NICB surveys of Monroe County in order to illustrate optimal 
designs for Job vacancy surveys. 
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C) Optimal Sample iX^sign for Estimating Total Number of Job Vac a ncies 

Table 11 presents optimal sample sizes for total, job vacancies , 
using the following constraints: (aj a total cost of $9*500 (which vas the 

estimated cost in 19^5 prices of a continuing sample survey for obtaining 
job vacancy data of the size used by the NICB*), or (b) coefficients of 
variation of 0 . 025 * 0 . 05 , or 0.10. Sample designs for specified costs are 
given in columns (l) and (2) of Table 11 . The total sample size is approxi 
mately 600 employers, fable 12* which gives optimal sampling rates, shows 
that in the strata for employers with fewer than >0 employees, a lower 
sampling ratio is optimal for those in Industry Group h than for the small 
employers in Industry Group A (employers in construction, durable manufac- 
turing, and trade industries). Employers with 50 to 2V9 employees have 
similar sampling ratios for all industries. 

If the optimal sampling fraction in a stratum is larger than 0 . 5 ; 
including all firms is considered advisable. This criterion was discussed 
by Leslie Kish as follows: 



For computing means, aggregates, and t' air variances the for- 
mulas of Section 5-3 are applied. In the variance formula... it may 
be noted again that increasing all the allocations n^ proportionally 
by the factor k decreases the overall variance by the* 4 same factor — 
if changes in f^are negligible. 

But optimum allocation is precisely the method that may lead 
to situations where the values (l - f in some strata are too large 
to be negligible. Moreover, sometimes’ in one or more of the extreme 
strata the formula .. .may point to values of close to 1 or even over 1 
In such cases, all elements of these strata should be taken into the 
sample. The extreme strata, if sampled completely, do not contribute 
to the variance of the combined estimate.** 






The optimum formula.- .. .may result, in the impossible allocation 
and f ^> 1 . This can occur when a rather large sample is needed 




* Based on data presented in Measuring Job Vacancie s, p. 77. 

** Kish, p. 94 . 
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(a) For definition of industry groups see Table 9 5 footnote (b). 



from a skewed population of establishments or inventories* In the 
extreme strata the values of S^may be so large that the formula 
leads to the impossible preliminary result. This solution lies in 
the mathematical region where the contribution of the extreme strata 
to the sum of variances. . .would be negative. The first practical 
step is to make these variances zero by making f ^ = 1 and n^ » N ^ . 

In practice we may decide to take this step for any stratum "where - 
f 0.5, let us say.* 

The use of the criterion that all sampling units are included in 
each stratum with an optimal sampling fraction of 0.5 or more results in a 
sample which comprises all firms with 1,000 or more employees and those 
with 250 to 999 employees In Industry Group B. One out of every two firms 
with 250-999 employees in Industry Group A should be selected for the 
design of this optimal sample. 

An estimate of the variance of vacancies is needed to compute the 
optimal sample size from equation (lj). Since the coefficient of variation 
(ratio of standard error to the estimated statistic ) has been predetermined, 
the variance can be estimated as follows: 

2 

Variance » (Vacancies x Coefficient of variation) 

The average sample size necessary to obtain estimates of total vacancies 
with a coefficient of variation of 0.05 is estimated at about 600 firms 
(Table 11 ). This is similar to the sample size corresponding to a given 
total cost of $9,500. To obtain survey results with a coefficient of 
variation of 0.025, a sample of about 1,500 firms is needed, while if it 
is sufficient to estimate total job vacancies with a coefficient of 
variation of 0.10, a sample of 220 firms would suffice. 

In Table 15 the average optimal sample size for tot*l job vacan- 
cies, as well as the largest sample size per stratum, is given. If the 
largest sample size is selected for each stratum, the variance of the 
resulting sample will be no greater than that specified for the optimal 
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sample design, “but the cost will be increased. For example, for the coeffi- 
cient of variation of 0 . 05 , the sample including the largest size per stra- 
tum results in a total sample size of 789 firms. This sample includes over 
100 more firms than the largest optimal sample size for a coefficient of 
variation of 0.05, which is 657 firms for the data of Survey 1. 

If, on the other hand, we assume that the results of the three 
surveys differ only on account of sampling variations and take an average 
of the three survey results, the total sample size for a coefficient of 
variation of 0 . 05 , including all firms in strata where the sampling frac- 
tion is larger than 0 . 5 , is as follows: 



Table Ih* Selected Sample Design for Estimating Total Job Vacancies to 
Obtain a Coefficient of Variation of 0.05 



Size of 

Reporting Unit 
(Number of 
Employees ) 



Number of Firms in Sampling Ratio of Firms in 

Industry Group 8 Industry Group 

A B A B 



0-7 


157 


82 


1:27 


1:61 


8-49 


158 


52 


1:8 


1:15 


50-249 


57 


55 


l: r 


1:5 


250-499 


10 


5i b 


5 :i 2 


1:1 


500-999 


7 


21 ° 


7:17 


1:1 


1,000-2,499 


5 b 


4 


1:1 


b:9 


2,500 or more 


v 9 


4 b 


1:1 


1:1 



Total 612 



(a) For definition of industry groups see Table 9, footnote (b). 

(b) The average optimal sample sizes were increased in these strata to 
include all firms, since the optimal sampling fraction was at least 

0.5. 



Source: Based oil Table 13 . 



The cost of one survey which follows the optimal sample design 
given in Table lii is approximately $10,100, and theoretically the sample 



estimates would result in a coefficient of variation for total Job vacan- 




cies of 0 . 05 . 
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The sample used in the NICE surveys of Monroe County in 1965 in- 
cluded vith certainty all firms with 250 employees or more on the selection 
date. The optimal design suggested above included with certainty firms with 
250 or more employees except employers with 250-999 employees in Industry 
Group A, and those with 1,000-2,499 employees in Industry Group 3, vbei*e 
one out of every two firms was selected. The characteristics of the firms 
which should he selected with certainty usually vary according to the size 
of the area being covered and the distribution of firms by employment size 
and industry. 

D) Optimal Sample .Design for Estimating Changes in Number of Total Job 
Vacancies 

The criterion to be used for the design of the optimal sample to 
measure changes in job vacancies which occurred between survey periods is 
ba?. 1 on the samples detecting changes of 0*5$ of total labor demand (em- 
p,. w .at plus vacancies) with 95$ confidence. In 1965 the average labor 
demand for Monroe County was 276,000 jobs. The number of vacancies which 
represents one -half of one per cent vould therefore be 1,380. If the sample 
estimate of change has a standard error of 690 vacancies, then changes in 
vacancies of one-half of one per cent are detectable vith 95$ 
confidence. 

Optimal sample designs for a standard error of change of 690 
vacancies for three-month periods are given in Table 15* The optimal sample 
for changes which occurred between Survey 1 and Survey 2 requires 381 firms, 
while one based on the changes which occurred between Survey 2 and Survey 3 
requires only 278 firms. If all firms in strata where the sampling fraction 
is 0.5 or larger are included with certainty, an optimal sample design for 
estimating changes in total job vacancies with a standard error of 690 
O vacancies would be as follows: 
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Table 15. Optimal Sample Size for Estimates of 
Changes in Total Job Vacancies 



Size of Reporting Un 
(Number of Employees 


it 


Optimum 


for Standard Error of 
690 Job Vacancies 


Change of 




) February-May 


May-August 


Average Sample Size (bj 


Industry Group (a) 
A B 


Industry Group 
A B 


Industry Group 
A B 




w 


C 2 r 


(3) 


(4) 


(51 


W) 






NUMBER OF 


FIRM 


s 




0 - 7 


76 


T9 


53 


4l 


64 


60 


8 - 49 


99 


36 


65 


25 


82 


30 


50 - 249 


24 


20 


25 


21 


24 


20 


250 - 499 


6 


12 


6 


22 


6 


17 


500 - 999 


4 


10 


3 


6 


4 


8 


1 ,COO - 2,499 


3 


2 (e) 


2 (c) 


2 (c) 


2 


2 


2,500 or more 


7 


3 


5 


2 (c) 


6 


2 


Total 




381 


278 




327 



(a) For delinition of industry groups see Table 9s footnote (b)* 

(b) Arithmetic mean of the two optimal designs given in columns 1-4 of this Table, 
(e) See Table 11, footnote (b). 

Source: Eased on data from the 393 units that responded to all three NICB surveys. 




77 



1V-21 



Table 16 , Selected Sample Design for Estimating Changes in Total Job 
Vacancies Which Measure 0 . 5 $ of (E+V) with 95 $ Confidence 



Size of 

Reporting Unit 
(Number of 
Employees ) 


Number of 
Industry 
A 


Firms in 
Group 8 
B 


Sampling Ratio of Firms in 
Industry Croup 
A B 


0-7 


64 


60 


1:59 


1:82 


8-1)9 


82 


50 


1 :l6 


1:25 


50-249 


24 


20 


1:8 


1:9 


250-499 


6 


3l b 


6:25 


1:1 


500-999 


4 


8 


4:17 


8:21 


1,000-2,499 


5 b 


2 


1:1 


2:9 


2,500 cr more 


v 9 b 


4 b 


1:1 


1:1 


Total 


549 







(a) For definition of industry groups see Table 9 > footnote (b). 

(b) See Table lh , footnote (b)* 

Source: Based on Table 15 * 

The total sample si2e described in the table above is smaller 
than the sample size used for the NICB surveys. The distribution by strata 
of the 395 employers that responded to the three NI ?3 surveys is the follow- 
ing: 



Size of Reporting Unit 
(Number of Employees) 


Number of Firms in 
A 


Industry Group 8 
B 


0-7 


44 


47 


8-49 


65 


40 


50-249 


58 


42 


250-499 


25 


31 


500-999 


17 


21 


1,000-2,499 


5 


9 


2,500 or more 


. 9 


4 


Total 


^ 

595 


f 



(a) For definition of industry groups see Table 9 > footnote (b). 



Source: NICB surveys. 
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However, if the sample sizes in the l 4 strata are analyzed separately, it 
will be noted that the sample is not reduced in all strata. In fact, the 
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optimal sample size is larger than the NICE sample for employers with 7 or 
fewer employees in both industry groups and for those wit}. 3-49 employees 
in Industry Group A. Therefore , the distribution of the optimal sample for 
the estimation of changes in job vacancies differs from the distribution of 
the sample used for the NICB surveys. 

The optimal sampling ratios for estimates of three- month changes 
in job vacancies are given in Table 17* For the strata corresponding to 
the smaller firms, those with fewer than 8 employees and t-ose with 8-49 
employees, the optimal sampling ratio is larger for firms in Industry Group 
A than for those in Industry Group B. However, for firms with 250-499 em- 
ployees, a sampling ratio of one out of every four firms in Industry Group 
A is optimal, while approximately one out of every two firms should be 
included in Industry Group B. For firms with 2,500 or more employees, the 
optimal sampling ratio is at least one of every two firms. In this case 
all firms should be included with certainty. Besides the arguments given 
for the adoption of this criterion in Section C, an open-end stratum may 
include a giant employer. If uhis employer were omitted from the sample, 
the sample estimates might be very inaccurate. 

Table 16, which gives an average sample size based on the optimal 
sample designs computed for the two three-month survey periods in Table 1^, 
assumes that the differences between the two estimates are due to sampling 
variation only If significant differences exist between the two periods, 
the optimal sample design to be chosen should select from each stratum 
the largest number of sampling units. This has been done in Table l p , below* 
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Table 17. Optimal Sampling Ratios of Firms for Estimates of 
Changes in Total Job Vacancies 



Optimum for Standard Error of 

Size of Reporting Unit Change of 690 Job Vacancies 

(Number of Employees) February -May May-August 

industry Group (a) Industry Group 

A B A B 



0 - 


7 


1:50 


1:62 


1:71 


1:120 


8 - 


1*9 


1:13 


1:20 


1:20 


1:29 


50 - 


2U9 


1:8 


1:9 


1:7 


1:9 


250 - 


1*99 


1:4 


12:31 


1:4 


22:31 


500 - 


999 


4:17 


10:21 


3:17 


2:7 


1,000 - 


2,1*99 


3:5 


2:9 


2:5 


2:9 


2,500 or 


more 


7:9 


3:4 


5:9 


1:2 


(a) Foi 


’ definition of 


industry groups see 


Table 9, footnot 


(b). 




Source i 


Based on data 


from the 393 units that responded to 


all three 


NICE surveys 
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Table 18. Largest Optimal Sample Size for Each Stratum to Estimate 
Three -month Changes in Vacancies of 0.5$ of (E+V) with 95$ Confidence 



Size of 

Reporting Unit 
(Number of 
Employees) 



Number of Firms in 
Industry Group 8 
A B 



Sampling Ratio of Firms in 
Industry Group 
A B 



0-7 


76 


79 


1:50 


1:62 


8-49 


99 


36 


1:13 


1:20 


50-249 


25 


21 


1:7 


1:9 


250-499 


6 


31 b 


6:23 


1:1 


500-999 


4 


10 


4:17 


10:21 


3,000-2,499 


5 b 


2 


1:1 


2:9 


2,500 or more 


ob 


4 b 


1:1 


1:1 



Total 407 



(a) For definition of industry groups see Table 9> footnote (b). 

(b) See Table lli, footnote (b). 

Source. Based on Table 15» 



The total sample size includes 58 more employers than the average 
optimal sample presented in Table l6. The sample given in Table 18 is se- 
lected so as to provide estimates of three -month changes in vacancies which 
measure 0.5$ of employment plus vacancies in Monroe County with 95$ confi- 
dence. The sample includes with certainty all employers with 2,500 
employees or more, also those with 250-499 employees in Industry Group B, 
and these with 1,000-2,499 employees in Industry Group A. 

E ) Optimal Sample Design for Estimating the Job Vacancy Rate 

The job vacancy rate (100V/V+E) is a counterpart measure to the 
unemployment rate. In other words, the unemployment rate measures the nun>* 
her of people seeking jobs (those who on the reference date were not holding 
a job) relative to the labor force (employed plus unemployed seeking employ- 
ment) in the given area} the vacancy rate, on the other hand, measures the 
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number of jobs which employers are seeking to fill on the reference date, 
relative to employment plus vacancies (a measure of labor demand) for the 
given area. The job vacancy rate converts the total number of job vacarv- 
cies to a relative measure, thus permitting comparison of job situations in 
areas of differing s?_ze. 

Table 19 shows optimal sample designs to estimate job vacancy 
rates with a coefficient of variation of 0.05 and 0.10. To obtain a coeffi- 
cient of variation of 0.05* the optimal bample computed varies between 

555 and 625 employers. However, for a coefficient of variation of 0.10 the 
total sample size is reduced to between 201 and 262 employers. Table 20 
gives the optimal sampling ratios to estii .e the job vacancy rate with a 
coefficient of variation of 0.05 and with a coefficient of variation of 
0.10. In this table, it should be noted that the sampling ratios for 
employers with fewer than 50 employees are larger for those in Industry 
Groxip A than for those in Industry Group B. For example, optimal sampling 
ratios in Survey 5 for employers with fewer than 8 employees were 1:22 for 
those in Industry Group A, while they were 1:60 for those in Industry Group 
B. For employers with 50-2^9 employees the optimal sampling ratios were 
similar for both industry groups. 

In Table 21 an average optimal sample design to estimate job 
vacancy rates with a coefficient of variation of 0.05 is presented, the 
sample sizes being increased to include all units in the strata where the 
average optimal sampling fraction was at least 0.5: 
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Table 19- Optimal Sample Size for 
Estimates of the Total Job Vacancy Hate 



Survey Period 


Number of Firms 
Sample for Coefficient 


in Optimal 
of Variation of 


Per Cent Distribution of Finns 
in Optimal Sample Design (c) 


and 

Size of Reporting Unit 
(Number of Employees) 


0.05 0.10 

Industry Group (a) Industry Group 
A B A B 


Industry Group 
A B 


February 


0 - 


7 


119 




131 


51 


56 


19-7 21.5 


8 - 


1*9 


184 




34 


T9 


15 


30.4 5.6 


50 - 


21*9 


33 




29 


14 


12 


5-4 4.8 


250 - 


1*99 


6 




20 


3 


9 


1.0 3.3 


500 - 


999 


8 




IT 


4 


7 


1.4 2.9 


1,000 - 


2,^99 


2(b) 


6 


2(b) 


3 


0.2 1.0 


2,500 or more 


9 




4 


4 


3 


1.7 1.2 


Tota) 




602 




262 




100.0 


Kay 


0 - 


7 


126 




92 


46 


33 


23-1 16.8 


8 - 


49 


124 




54 


45 


20 


22.7 9.9 


50 - 


249 


45 




34 


16 


12 


8.2 6.2 


250 - 


499 


12 




12 


4 


4 


2.2 2.1 


500 - 


999 


7 




10 


3 


4 


1.3 1.8 


1,000 - 


2,499 


4 




4 


2(b) 


2 


0.7 0.8 


2,500 or 


' more 


9 




CL 


8 


_2(b) 


3.8 0.4 


Total 






535 




201 




100.0 


August 


0 - 


7 


193 




84 


71 


31 


30.0 13.0 


8 - 


49 


143 




60 


52 


22 


22.2 9*4 


50 - 


249 


30 




35 


11 


13 


4.6 5.4 


250 - 


499 


8 




31 


3 


14 


1.3 6.1 


500 - 


999 


10 




n 


3 


4 


1.5 1.8 


1,000 - 


2,499 


3 




4 


2(b) 


2 


0.5 0.7 


2,500 or 


■ more 


9 




2 


8 


J?(b) 


3.3 0.2 


Total 






623 




238 




100.0 



(a) For definition of industry groups see Table 9, footnote (b) . 

(b) See Table 11, footnote {b). 

(c; Dving to rounding, percentage distributions do not necessarily add to total. 

Source: lascd on da* a from all units that responded to the NICB surveys. 
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(a) For definition of industry groups see table 9> footnote (b) . 
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Table 21* Selected Sample Design for Estimating the Job Vacancy 
Rate with a Coefficient of Variation of 0.05 



Size of 
Reporting Unit 
(Number of 
Employees) 



Number of Firms in Sampling Ratio of Firms in 
Industry Group 8 Industry Group 

A B A B 



0-7 


146 


102 


1:29 


1:49 


8-49 


150 


49 


1:9 


1:16 


50-249 


36 


33 


1:5 


2:11 


250-499 


9 


31* 


5:8 


1:1 


500-999 


8 


21° 


8:17 


1:1 


1 , 000 - 2,499 


5 b 


9 b 


1:1 


1:1 


2,500 or more 


9 


4b 


1:1 


1:1 



Total 



612 



(a) For definition of industry, groups see Table 9, footnote (b). 

(b) See Table 14, footnote (b). 

Source: Based on Table 26, 



The optimal sample size in Table 21 is 612 employers. The sample 
includes with certainty all employers with at least 1,000 employees, and 
employers in Industry Group B with 250-999 employees. For employers with 
250-999 employees in Industry Group A, a sampling ratio of approximately 
1:2 would be adequate. All employers with 50-249 employees should be 
selected with a sampling ratio of 1:5- The sampling ratios corresponding 
to the strata of employers with fewer than 50 employees are smaller for 
employers in Industry Group B than for those in Industry Group A within 
each employment size category. The cost of one survey using the sample 
distribution suggested in Table 21 would be approximately $10,500, on the 
basis of the costB per stratum given in Table 9- 

Alternatively, instead of selecting an average of the three opti- 
mal samples for vacancy rateB, the largest sample size per stratum can be 
selected. Table 22 below corresponds to this latter method. 
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Table 22 .Largest Optimal Sample Size for Each Stratum to Estimate 
the Job Vacancy Rate vith a Coefficient of Variation of 0.05 



Size of 

Reporting Unit 
(Number of 
Employees) 



Number of Firms in Sampling Ratio of Firms in 
Industry Group 8 Industry Group 

A B A B 



0-7 


195 


151 


1:22 


1:58 


8-49 


184 


60 


1:7 


1:15 


50-249 


k K 


55 


1:4 


1:5 


250-499 


2 4b 


51 


1:1 


1:1 


500-999 


17* 


2lb 


1:1 


1:1 


1,000-2,499 


5 b 


9 b 


1:1 


1:1 


2,500 or more 


9 


4 


1:1 


1:1 


Total 


768 









(a) For definition of industry groups see Table 9* footnote (b). 

(b) See Table lh, footnote (b). 



Source: Based on Table 19* 



The average optimal sample size for estimating the Job vacancy 
rate is 612 employers; the sample obtained by selecting the largest number 
of sampling units per stratum requires 768 employers. Ihis latter sample 
includes vith certainty all employers vith 250 employees or more. The 
cost of the sample given in Table 21 vas approximately $10,500, vhile the 
sample in Table 22 would cost about $11,700. In Section G of thia chapter 
the various possible samples will be compared to determine the most 
desirable alternative in terms of reliability of results in relation to cost. 




F) Optimal Sample Pesign for Estimating Changes in the Job Vacancy Rate 

Changes in the Job vacancy rate suggest a tightening or loosening 
of the labor market. One of the objectives of the Job vacancy surveys is 
to detect an economically significant change vith reasonable confidence. 

In Table 23 optimal sample designs for achieving a standard error of 0.25 
are given. These samples are designed to detect with 95$ confidence changes 
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in the job vacancy rate of 0.5$ or more. For example, the job vacancy rate 
wai approximately 5$ in Monroe County in 1965* The sample designs given in 
Table 23 would detect with 95$ confidence changes in the vacancy rate of 
either from 5.0$ to 3*5$ or from 3.0$ to 2.5$. If it were required to 
detect smaller changes, the sample size would need to be increased. 

The estimated optimal sample size for three-month changes in the 
vacancy rate with a standard error of 0.25 is 268 and 408 employers. The 
average optimal sample size for three-month changes (Table 26) is 337 em- 
ployers. Table 25 gives optimal sampling ratios for changes in the two 
three-month periods (February-May and May-August), and also for the six- 
month period (February -August ) , 

In Table 2b below, an average optimal sample for estimating 
three-month changes in the job vacancy rate of 0*5 with 95$ confidence is 
given. Here, in the strata where the computed sampling fraction was at 
least 0.5j the sample size was increased to include all employers. 

Table 2b. Selected Sample Design for Estimating Three -month Changes 
of 0.5 or More in the Job Vacancy Rate with 95 $ Confidence 



Size of 

Reporting Unit 
(Humber of 
Employees) 


Number of Firms in 
Industry Group 8 
A B 


Sampling Ratio of Finns in 
Industry Group 
A B 


0-7 


65 


68 


1:53 


1:72 


8-49 


64 


30 


1:15 


1:25 


50-249 


23 


20 


1:8 


1:9 


£50-499 


6 


31 b 


6:25 


1:1 


500-999 


4 


8 


4:17 


8:21 


1,000-2/ ^9 


2 


2 W 


2:5 


2:9 


2,500 or more 




4 b 


1:1 


1:1 


Total 




356 







(a) For definition of industry groups see Table 9, footnote (b). 

(b) See Table lb, footnote (b). 

Source: Based on Table 26. 
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Table 25- Optimal Sampling Ratios of Firms for Estimates of Changes in 

the Total Job Vacancy Rate 
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Table 26. Average Optimal Sample Size for Vacancy Rates and Th~ee-month Changes 

in Vacancy Rates 
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Source: Columns 1-4 are based on data from aJ.1 units. Columns 5 and 6 are ba,sed on data from the 393 
units that responded to all three NICB surveys. 
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The sample size given in Table 21* suggests including 356 employers. 
The sample includes *dth certainty employers with 2,500 employees or more 
and employers with 250-499 employees in Industry Group B. For strata cor- 
responding to employers with fewer than 50 employees, the pattern of a 
smaller optimal sampling ratio for those in Industry Group B than for 
those in Industry Group A is similar to the result found in the optimal 
sample design for estimating the job vacancy rate. 

The total cost of the sample given in Table 24 is approximately 
$7,500. However, an average taken of two sample sizes assumes that the 
difference between them is due to sampling variation only. If, instead, 
the largest sample size is selected from each stratum, the standard of 
reliability established for designing the optimal sample is ensured. 

Table 27 below corresponds to this latter criterion: 



Table 27* Largest Optimal Sample Size of Each Stratum for Estimating 
Three -month Changes of 0.5 or More in the Job Vacancy Rate 
with 95$ Confidence 



Size of 
Reporting Unit 
(Humber of 
Employees) 


Number of Firra 3 in 
Industry Group 8 
A B 


Sampling Ratio of Firms in 
Industry Group 
A B 


0-7 


80 


94 


1:47 


1:52 


8-49 


loy 


55 


1:12 


1:21 


50-249 


25 


20 


1:8 


1:9 


250 - 1+99 


6 


5! b 


6:23 


1:1 


500-999 


1 * 


21 b 


4:17 


1:1 


1,000-2,1*99 


5 £ 


2 


1:1 


2*9 


2,500 or more 


9 b 


4 


1:1 


1:1 


Total 


441 







(a) For definition of industry groups see Table 9, footnote (b). 

(b) See Table U4, footnote (b). 



Source: Based on Table 23, 
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Four hundred and forty-one employers are required for the sample 
given in Table 27* The cost of this sample is approximately $8,5CO, which 
is $1,200 more than that of the average sample given in. Table 2h, but $1,000 
less than the estimated cost of the NICB surveys. Both the sample discussed 
in Table 2h and the one in Table 27 are designed to measure three-month 
changes in the vacancy rate of 0.5 with 95# confidence. 

G) Comparison of Sample Designs 

Job vacancy surveys should yield estimates not only of the number 
of vacancies and of the job vacancy rate, but also of the changes in vacan- 
cies and vacancy rates between survey periods. In Sections C-F, optimal 
sample designs to estimate each of the four statistics mentioned above 
have been discussed. The different optimal allocations are compared below. 
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(a) For definition, of industry groups see Table 9> footnote (b). 

(b) Owing to rounding, percentage distributions do not necessarily add to total. 
Sources; See following page. 
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The optimal percentage distributions for estimating job vacancies 
and the job vacancy rate on the survey reference date are similar, except 
for the stratum corresponding to employers with fewer than 8 employees in 
Industry Group B (Table 28). The distribution of the NICB sample, origi- 
nally designed to estimate total job vacancies, included all firms with 
250 or more employees (column ( 5 ) of Table 28), while the optimal samples 
for both job vacancies and job vacancy rates call for only partial coverage 
in this size range. The following tabulation summarizes the percentages 
which the larger employers represent in the three samples. 





Sample 


Percentage of Total Sample Represented 
by Employers with 250 or More Employees 


Optimal 


for 






Job Vacancies 


14.6 




Job Vacancy Hates 


15-6 


NICB 




29.5 


Source : 


Table 28. 





The principal reason for these differences is the wide variation in cost 
per employer, shown in Table 9* In designing the NICB sample, these costs 
were erroneously assumed to be the same for all sizes of firm, owing to 
the absence of information. 



Sources for Table H on preceding page: 

Column (l) is based on Table 11. 

Column (2) is based on Table 19* 

Column (5) is the per cent distribution of the arithmetic mean of the 
number of employers that responded to the NICB surveys. 

Column (4) is the average optimal per cent distribution for estimating 
changes in vacancies, based on the 393 employers that responded to 
all three NICB surveys. 

Column (5) is the average optimal per cent distribution for estimating 
changes in the vacancy rate, based on the 393 employers that responded 
to all three NICB surveys. 

Column (6) is based on the 393 employers that responded to all three 
NICB surveys. 
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The two distributions computed to estimate three-month changes, 
given in columns (4) and (5)> Table 28, are almost identical, but they differ 
from the samples given in columns (l) and (2) of Table 28, especially in the 
following strata: 

(a) Employers with 0-7 employees, Industry Group A. 

(b) Employers with 250-499 employees. Industry Group B. 

(c) Employers with at least 2,500 employees, Industry Group A. 

In Table 29 below, the cost and total sample size of the optimal 

samples described in the text tables cf Sections C to F of this chapter 
are given. In columns (l) and (2) average samples are given; in columns (3) 
and (4) the total sample size was formed by choosing the largest sample size 
for each stratum. All employers in the stratum were included when the 
samples were computed if the sampling fraction was at least 0.5* 



Table 29# Sample Size and Cost of Job Vacancy Surveys 





Average Optimal Sample 


Largest Sample Size 
per Stratum 


Criteria for 
Optimal Design 


Number of 
Employers 


Cost 


Number of 
Employe rs 


Cost 


Coefficient of 
Variation of 0.05: 


a) 


(2) 


( 3 ) 


(4) 


Job Vacancies 


612 


$10,081 


806 


$11,837 


Job Vacancy Rate 

Three-month Changes 
with 95$ Confidence: 

Job Vacancies of 


612 


10,324 


768 


11,688 


0.5$ of (B*V) a 
J~b Vacancy Rates 


J!*9 


7,436 


407 


7,885 


of 0.5$ 


356 


7,291 


44l 


8,462 



(a) E+V, employment plus vacancies represents total labor demand. 



Sources: Tables 9, 13, lb, 16, 18, 21, 22, 2b, and 27. 
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To obtain a coefficient of variation of 0 . 05 , the average sample 
size for both estimates of job vacancies and of the job vacancy rate is 
612 employers. Yet the cost of the tvo samples differs slightly because 
the composition of the samples by stratum varies (see Table 28 ), end the 
estimates of cost per firm in the separate strata are alco different (see 
Table 9). 

The criteria specified for estimates of changes in job vacancies 
and in Job vacancy rates can be satisfied “with smaller and, therefore, less 
costly samples. If a larger sample is selected and the sample size in each 
stratum is larger than that needed to estimate changes of 0.5$ with 95$ 
confidence, then all requirements are met. Table 30, below, gives the 
strata with optimal percentages for estimates of change that are larger 
than for estimates of totals. 



Table 30, Strata in Which Estimates for Changes Exceed Those for Totals: 
Percentages of Total Samples and Their Ratios 



Stratum 


Percentage 


to Estimate 


Ratio 

(2);(1) 


Percentage 


to Estimate 


Ratio 
(5 ) T (4 ) 


Number of Industry 
Employees Group 8 


Job 

Vacancies 


5 -month 
Changes in 
Vacancies 


Vacancy 

Rates 


3 -month 
Changes in 
Vacancy 
Rates 






(i) 


(2) 


(5) 


(4) 


(5) 


~wr 


0-7 


B 


15.0 


17.9 


1.58 


17.1 


19.6 


1.15 


8-49 


B 


8.8 


9-3 


1.06 


8.3 


9-0 


1.08 


50-249 


A 


6.5 


7.7 


1.22 


6.1 


7.2 


1.18 


50-249 


B 


5.8 


6.4 


1.10 


5-5 


6.1 


1.11 


250-499 


A 


1.7 


1.9 


1.12 


l.p 


1.8 


1.20 


250-499 


B 


5.8 


5.6 


1.47 


5.8 


5.4 


1.42 


500-999 


B 


2.2 


2.5 


1.14 


2.2 


2.4 


I .09 



(a) For definition of industry groups see Table 9, footnote (b). 



Source: Table 28, 



In ell other strata, if a total sample size larger than the opti- 
mal for estimates of change is selected, estimates of changes between survey 
periods with the desired accuracy will necessarily be obtained. In the case 
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of the strata listed in Table 30, if a sample size meets the required preci- 
sion of the estimates of total job vacancies, it is possible that, even 
vhen the optimal percentage for estimates of change is larger, the sample 
size chosen may in fact be adequate. For example, in Table lii, in the 
stratum with fewer than 8 employees in Industry Group B, a sample size of 
82 units is required; in Table 16, which gives the average sample for esti- 
mating changes in vacancies, the sample corresponding to the same stratum 
comprises only 60 units. Therefore, if a sample of 612 units is chosen 
(including 82 units in the above mentioned stratum), the resulting esti- 
mates of changes in vacancies will also be of the neressax*y precision in 
this stratum. If the total sample size for total vacancies is 5 0$ larger 
than the sample size for estimates of changes, it follows that the sample 
sizes in each stratum will be large enough to satisfy all criteria. This 
holds since the largest ratio of 1.47 occurs in the stratum of employers 
with 250-499 employees in Industry Group B. 

However, in Table 31* it must be noted that the sample sizes for 
estimates of job vacancies and of th job vacancy rate are always larger 
by more than 5 Qf> than the estimated optimal sample sizes for changes. 



Table 31* Ratio of Estimates for One Survey Period to Estimates for 
Three -Month Changes for: Optimal Sample Size and Cost 









Ratio 




Estimates 






Sample Size 
(Number of Employers) 


Cost 


Average of Job Vacancies to 
Average of 3 -month Changes 


in 


Vacancies 


1.75 


1.36 


Average of Job Vacancy Rate to 
Average of 3 month Changes in 


Rates 


1.72 


1,42 


Largest of Job Vacancies to 
Largest of 3-rnonth Changes 


in 


Vacancies 


1.98 


1.50 


Largest of Job Vacancy Rates 
Largest of 3 -month Changes 


to 

in 


Rates 


1.74 


1.38 



O Source: Table 29* 
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Therefore, if the optimal sample sizes for estimating job vacancies or job 
vacancy rates with a coefficient of variation of 0.05 are chosen, the sample 
will also meet the requirements for estimating changes of 0.5$ with 95$ 
confidence . 

In the selection of a sample which meets all the criteria estab- 
lished in Sections C to F, the largest sample size for each stratum should 
be chosen. Table 32 gives the resulting samples. 



Table 32* Largest Sample Size for Each Stratum of the Designs 
Given in Sections C to F 



Size of Reporting 


Average Optimal 


Sample 


Largest Optimal 


Sample 


Unit and 


in Industry Group 


in Industry Group 


Cost 


A 


B 


A 


B 


0-7 


157 


102 


203 


l4o 


8-49 


158 


52 


207 


61 


50-249 


37 


35 


47 


37 


250-499 


10 


31 


24 


31 


500-999 


8 


21 


17 


21 


1,000-2,499 


5 


9 


5 


9 


2,500 or more 


9 _ 


4 


^ 9 


4, 


Total 


658 




815 




Total Cost 


$10,533 




$12,040 




(a ) For definition 


of industry groups 


see Table 


9, footnote (b). 




Sources: Tables 9, 


13, 14, 16, 18, 21, 


22, 24, s 


.nd 27. 





Although the table given above shows the largest sample size in each stratum, 
the sample size usually corresponds to the estimates for the total number of 
Job vacancies (Section C); possible exceptions might occur, however, in the 
three strata listed in Table 33 below. 
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Table 33* Strata in Which Optimal Percentages Are Larger for 
Estimates of Vacancy Rates than for Estimates of Job Vacancies 



Stratum 




Optimal percentages for Estimating 


Number of Employees 


Industry Group 8 


Job Vacancies 


Job Vacancy Rates 


0-7 


B 


13.0 


17-1 


500-999 


A 


1.1 


1.4 


1,000-2,499 


B 


0.7 


0.8 



(a) For definition of industry groups see Table 9 , footnc (b). 
Source: Table 28, 



If the several differing estimates result from sampling variation 
only, then it is sufficient to choose the average sample given in Table 3?> 
which comprises 638 sampling units and costs approximately $10,500. This 
sample includes about 200 more sampling units than the NICB survey of Mon- 
roe County did, and would cost about $1,000 more. However, the desired 
precision of this sample is a coefficient of variation oi 0.05 for estimates 
of job vacancies and of the job vacancy rate, while the achieved NICB pre- 
cision is a coefficient of variation of 0.07 » 

If, on the other hand, the variations am.ng the estimates of 
Survey Periods 1, 2, and 3 are considered to be due to seasonal variations 
or to other economically significant factors, and not exclusively to sampling 
variability, the largest sample should be chosen in each stratum. This 
sample includes 815 sampling units and costs approximately $12,000. The 
NICB surveys provide three quarterly observations. If significant seasonal 
or other variations exist, estimates for the fourth quarter would be needed 
to provide adequate data on which to base the optimal sample design. 

If Tables 1^ and 27 are compared and the largest sample size in 
each stratum is chosen, the following sample for the purpose of estimating 
three -month changes would result. 
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Table 34 • largest Sample Size for Each Stratum of the Designs to 
Estimate Three -month Changes Given in Tables 18 and 27 





Number of Employers in 


Size of Reporting Unit and Cost 


Industry Group® 




A 




B 


0-7 


80 




94 


8-49 


107 




56 


50-249 


25 




21 


250-499 


6 




51 


500-999 


4 




21 


1,000-2,499 


5 




2 


2,500 or more 


9 




4 


Total 




445 




Total Cost 




$9,517 





^a) For definition of industry groups see Table 9> footnote (b). 



Sources: Tables 9, 18, and 27, 

Therefore, if the survey is designed to estimate changes in vacancies of 
0.5$ of total labor demand (E+V) or changes of 0.5$ in the job vacancy 
rate with 95$ confidence, a sample of 445 sampling units (employers) will 
suffice. Such a sample would cost approximately $8,500 per survey. It is 
interesting to note that although this sample is larger than the sample 
used in the NICB surveys of Monroe County, the estimated cost per survey 
is $1,000 less. 



Summary 



We have adopted the following criteria for the selection of 




samples of adequate precision: 

(a) A coefficient of variation not greeter than 0.05 for total job 
vacancies. This is equivalent to a 95$ confidence interval, 
from 0.90V 1 to 1.10V t , for two standard errors are 10$ of V ! , 
the sample estimate of vacancies 

(b) A coefficient of variation not greater than 0.05 for the Job 
vacancy rate. This Is equivalent to a 95$ confidence interval 
from 0.90R 1 to 1.10R 1 where R 1 is the sample estimate of the 
job vacancy rate 
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(c) Detection, with 95$ confidence, of a change of 0.5 or more in the 
number of vacancies as a per cent of total labor demand (employ- 
ment plus vacancies) 

(d) Detection, with 95$ confidence, of a change of 0.5 or more in the 
job vacancy rate 

Techniques for sample selection using these criteria are developed and il- 
lustrated with data from the NICB 1965 surveys in Monroe Jounty, New York. 
The conclusions listed below depend to some extent on the nature of the 
area studied. However, ve believe that they are of general applicability 
to areas with other industrial structures and labor market situations. 

1. Stratification by size of firm and by industry improves sampling 
efficiency. 

2. Survey costs vary significantly by size of employer in surveys 
seeking detailed description of each class of Job vacancy. This 
consideration should be taken into account to obtain an efficient 
sample design. 

J. The criteria for measuring changes, (c) and (d) above, may be met 
with smaller, and therefore less costly samples than the criteria 
for measuring total Job vacancies or the job vacancy rate, (a) and 
(b) above. 

4. A sample designed to measure total vacancies or the vacancy rate 
is probably adequate to measure changes as veil (if the criteria 
stated above are reasonable). This was true of the designs de- 
veloped for Rochester, although the relative distributions among 
the strata differ according to the criterion selected. 
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Chapter V: GENERAL METHODS FOR DETERMINING STRATA AND SAMPLE SIZES 



In this chapter certain general procedures for the design of optimal 
survey samples are analyzed, with the objective of establishing which ones 
would be applicable to areas with differing characteristics. A certain homo- 
geneity of methods is advisable for vacancy surveys* especial _y those which 
cover different areas, but at the same period of time. The statistics thus 
derived could provide bases for estimates on population subclassil lections 
(industries, for example). 

Statistical theory recommends that certain characteristics, such as 
the number of establishments and the patterns of vacancies in an area* be 
taken into account in designing a vacancy survey. Consideration of such charac- 
teristics not only influences sample design in general, but, in particular* the 
choice of both strata boundaries and sample sizes as well. Optimal strata, and 
optimal sample sizes in each area will depend to a large degree on the size of 
the area chosen and on its prevailing job vacancy rate. 



A) The Choice of Stratification Variables 

Theoretically* the best stratifying variable wruld be the one to be 
measured in the survey (see Chapter II, Section A and Chapter IV, Section A). 
Therefore* if employers can be stratified according to the number of vacancies 
they have* maximum gains are obtained from stratification. When this variable 
is not available, some alternative.; may be employed* such as: 

a) a variable highly correlated with the variable to be measured* or 

b) a variable which classifies the population of establishments into such 
domains of study as are desirable for job vacancy statistics. 

If the first criterion mentioned above is used, stratification of 
establishments by number of employees is presumed advantageous, since larger 
O ?lishments are likely to have more job vacancies than small establishments. 
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The relationship between job vacancies and employment is not necessarily linear, 
however, inasmuch as vacancies depend on current labor shortages and on expected 
labor turnover, as well as on any projected expansion or curtailment of employ- 
ment in firms.* Moreover, new operations have higher job vacancy rates than 
stabler ones, and these, in turn, have a higher rate than the so scheduled to 
close. In the NICB surveys, the highest average immediate vacancy rate of 3.7 
corresponds to those firms with 10-49 employees, and the estimate ' rate is lower 
for both employers with 50 or more employees and those with fewer than 10 employees. 
In regard to b), the second alternative, the distribution of job 
vacancies by industry, is one of the measures to be derived from a job vacancy 
survey and is a characteristic of the sampling unit. Therefore, stratification 
by industry would improve the quality of estimates of vacancies by industry. 

B) Ti e Choice of the Number of Strata 

The total variance for any survey estimate, 3^, can be divided into a 
portion, S^, which can be reduced when a stratified sample is chosen plus another 

p 

portion which is independent of stratification, S^, 

S 2 = S 2 s + s 2 e 

It has been shown**that the portion of the variance susceptible to reduction by 
the use of stratification decreases inversely with the square of the number of 
strata. This relationship is exact for a rectangular distribution and approxi- 
mate for samples selected from skewed distributions . As the number of strata 
increases, the portion of the variance independent of stratification will soon 
dominate the estimate of total variance. To increase the number of strata 



* A more precise discussion of the factors determining job vacancies can be found 
in John G. l^yeij. "Job Vacancies in the Firm end the I^bor Market," The Conference 
Board, May, 1968. 

*-* Cochran, p, 133. 



O 




103 



V-3 



beyond 6* does not, it is generally agreed, increase the accuracy of estimates 
in 2‘elation to the increase in cost, except when the strata correspond to sub- 
groups for which separate estimates are desired. In the prasent study the 
sample design for Rochester, N. Y. , uses seven size strata and each of these is 
substretified into two industry groups. This gives fourteen size-industry strata. 
For e. larger labor area, a greater number of industry substrata might be advisable. 

C) The Formation of Strata in the Population 

The rule in use to determine the best boundaries for size strata was 
suggested by Dalenius and Hodges**. It has been found both efficient and easy 
to apply***. Let fy be the frequency function of establishments classified by 
number of employees in a given area; If the establishments have been grouped into 
classes of unequal width, let dy be the number of a predetermined standardized 
unit in each size group. Then the cumulative of \J f y d y is formed and the total 
range is divided into equal intervals which, in turn, determine the best boundaries 
of the strata. The data from the NICE surveys of Rochester, N. Y., have been used 
here to find optimal size strata by following this rule. In the table below 
optimal size strata were also calculated for New York, N. Y., and Richmond, 
Virginia****. 

Before determining the best boundaries between size strata, the very 
large establishments of the ere a were separated and grouped to form a stratum 

* TbiTT, p. 134 . 

** Tore Dalenius and Joseph L. Hodges, Jr., "Minimum Variance Stratification," 
Journal of the American Statistical Association ^ March 1959, pp. 88-101. 

*** William G. Cochran, "Comparison of Methods for Determining Stratum Boundaries," 
Bulletin of _the International Statistical Institute , Vol, 38 (l96l), 2, 

pp - 345-353. 

**** The distribution of establishments by size was taken from County Business 

Patterns 1965 * except for the distribution of establishments with 500 or more 
employees in New York, N. Y., which was obtained from the New York office of 
/he Bureau of Employment Security. 
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that could he included with certainty, since large establisliments are likely to 
include a great proportion of the vacancies and the estimated variance is also 
very large (see discussion in Chapter IV, Section D; . For all other establish- 
ments six optimal size strata were calculated, as shown below. 

Table 35. Optimal Size Strata for Rochester, N. Y. , New York, N. Y. , and 
Richmond, Virginia, in 1965 



Stratum 




Six Optimal Strata for Establishments with 




Fewer than 

Employees 

Rochester. 


2,500 

in 

N. Y. 


Fewer than 5,000 
Employees in 
New York, N. Y. 


Fewer than 500 
Empl^' r ees in 
Richmond, Va. 




Number of 
Employees 


Stratum 

Width 


Number of 
Employees 


Stratum 

Width 


Number of Stratum 

Employees Width 


1 


4 or fever 4 


5 or fewer 


5 


4 or fewer 


4 


2 


5-20 


16 


6-21 


16 


5-13 


9 


3 


21-79 


59 


22-73 


52 


14-35 


22 


4 


80-255 


176 


74-249 


176 


36-83 


48 


5 


256-770 


615 


25 O- 96 O 


711 


84-196 


113 


6 


771 - 2,499 


1,729 


96 1-4,999 


4,039 


197-499 


303 


Number of 


2 , 500 or more 


5,000 or more 


500 or more 




Establishments 


employees 




employees 




employees 




With 
















14 




34 




30 




Number of 














Employees 


247 ,001 




3,828,271 




154,914 





Sources: For distribution of establishments, see text. 

For number of employees: County Business Patterns 1965 . 



From data in Table 35 the effect of the distribution of establishments 
according to number of employees on the computation of six optimal strata may be 
calculated. The calculations shown in the table determine the best boundaries 
in each case, .in New York, N. Y., an area with 3*8 million employees and with 
270,000 establishments in 1965 , the computation of six optimal size strata has 
included establishments with fewer than 5*000 employees. This leaves 34 employer* 
wita at least 5,000 employees which could be included with certainty. In Richmond, 
Virginia, which had 150,000 employees and 8,800 establishments in 1965 , there were 30 
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establishments vith 500 or more employees; these establishments constitute the 
certainty strata for this area. Since the six strata were computed for estab- 
lishments vith fever than 500 employees, the strata are much finer than the 
ones derived for xhe New York metropolitan statistical area. 

D) n„ : The Sample Size in Stratum g 

a " 

In this section, optimal sample sizes for Rochester, N. Y., are 
determined by the procedure outlined in Chapter IV, Section B. The analysis 
demonstrates that sample sizes must be changed as Job vacancy rates vary among 
areas, if a constant level of reliability is to be attained. 

By way of illustration, the table below gives immediate job vacancy rates 
for standard metropolitan statistical areas surveyed by the Department of Labor in 
1965 and 19 66 . 



Table 36 . Estimated Rate of Current Job Vacancies by Area, April 1, 1966 and 
April 15, 1965 



SMS A 


Estimated Total Current 


Job Vacancy Rate^ 


April 1, 1966 


April 15 , 1965 


Baltimore 


2 . 0 ^) 


1.1 


Birmingham 


1.1 


0.9 


Charleston, S. C. 


1.9 


2.1 


Charleston, W. Va. 


0.7 


0.9 


Chicago 


1.7 


1.1 


Hartford 


3*7 


Not available 


Kansas City 


1.1 


0.6 


Los Angeles 


1.5 


0.9 


Miami 


1.8 


1.1 


Milwaukee 


1.7 


1.7 


Minneapolis-St . Paul 


2.4 


1.3 


New York 


1.4 


1.0 


Portland, Ore. 


1.4 


1.0 


Richmond, Va. 


2.2 


2.0 



(a) Estimated number of vacancies as a per cent of the sum of estimated current 
employment and vacancies. 

(b) May 1966. 

O ;e: U. S. Department of Labor, Repor t on 1966 Job Vacancy Surveys, May 10, 1967 . 
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According to this table, the range of the job vacancy rate lies between 3»7 for 
Hartford in 1966 and 0.6 for Kansas City in 1965. 

The NICB surveys of Rochester, N. Y. , found a, vacancy rate there in 1965 
of approximately 3-0, a. figure which, however, cannot be considered comparable to 
the estimates given in the Department of Labor surveys, since the NICB surveys 
estimated both immediate vacancies and those with a fu starting date* The 
NICB survey data are used here to determine sample sizes which estimate vacancies 
with a coefficient of variation of 0.05 and of 0.10, This computation requires 
estimates of the variability of vacancies and of the cost per firm for each stratum 
defined. 

The cut-off point for the computation of six optimal size strata neces- 
sarily varies from one area to another. In Rochester, N. Y. , an area, with 250,000 
employees and 12,500 establishments in 1965, firms with fewer than 2,500 employees 
were included in the computation presented in Table 35j while in Richmond, Va. , 
for example, the six strata were computed from establishments with fever than 500 
employees. The optimal boundaries for Rochester, If, Y., must be modified to conform 
with the size strata actually selected for the NICB sample. This must be done to 
arrive at estimates of the element variance which can be derived only for the 
strata originally chosen or for any combination of them. 

The following size strata approximate the boundaries found in Table 35 
and will be used here to compute optimal sample sizes, 



Size 

Group 


Number of Employees of Establishments 
(on the selection date) 


1 


7 or fevrer {or of unknown size) 


2 


8 to 19 


3 


20 to 1+9 


4 


50 to 2'*9 


5 


250 to 749 


6 


750 to 2,499 


7 


2,500 or more 



o 
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Each size stratum is sub stratified into two industry groups to produce 
fourteen size-industry strata,. The two industry groups used are the same as 
those defined in Chapter IV, 



Industry 

Group 



Industry of Establishment 



A Durable manufacturing* construction* and trade 

B Nondurable manufacturing* public utilities* 

finance* services* and government 



For each size-industry stratum the element standard error and cost 
per firm are computed* and the results are shown in Table 37* 
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Table 37 - Element Standard Errors for Total Job Vacancies and Estimated Survey 
Cost Per Firm for Rochester Surveys in 19&5 
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These data may also be used to estimate sample sizes which would meet 
established levels of reliability if job vacancy rates were 2,5, 2,0, 1.5, or 
1.0. However, such estimates would be valid only if the distribution of estab- 
lishments, the variability of vacancies, and the cost per firm coincided with 
the ones for Rochester, N, Y. Nevertheless, the computation serves to point up 
the increased size of samples necessary to obtain the same level of reliability 
for estimates of a population with a smaller number of total vacancies than in 
Rochester in 1965* 

Table 38 gives the optimal sample sizes for the three 1965 NICE surveys 
and the estimated cost for each sample based on the element standard error and 
cost per firm shown in Table 37* The variations between the estimated sample 
sizes for each of the three quarterly observations shown in this table may be 
due to seasonal or to sampling variations. 

If seasonal variations irt the patterns of job vacancies by stratum are 
significantly different, optimal samples should be chosen by selecting the largest 
sample size in each stratum. If it is assumed that the fourth quarter (for which 
no data are available) would not differ significantly from the three estimates 
actually obtained, a sample so chosen would insure that the estimates of vacancies 
meet the specified reliability requirements. For example, in Table 39 such 
samples are given for the vacancies of Rochester in 1965, which correspond to a 
job vacancy rate of 3*0, approximately. 
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Table 38. Optimal Sample Sizes for Estimating Total Job Vacancies in 
Rochester, 1965 , and for a Job Vacancy Rate of 1.5 



Number of Establishments in Optimal Sample for (aT 

Job Vacancy Rate of Rochester, 1965 



Month 

and 

Number of 
Employees 



February 



Total Cost 



May 



Total 

Total Cost 



(Approximately 3*0) 



Coefficient of Variation 
0.05 0.10 

Industry Group (bV 



B 



$9,1+97 



616 

$9,557 



Industry Group 
A B 



Assumed Job Vacancy Rate: 1,5 

Coefficient of Variation 

0.05 0.10 



Industry Group 
A B 



$5,584 



$17,246 



239 

$5,257 




Industry Group 
A B 



0-7 


127 


134 


47 


49 


348 


367 


131 


138 


8-19 


71 


19 


26 


7 


194 


53 


73 


20 


20-49 


90 


15 


33 


5 


247 


40 


93 


15 


50-249 


34 


30 


12 


11 


92 


82 


35 


31 


250-749 


12 


31 


4 


11 


30 


44 


12 


32 


750 - 2,499 


4 


14 


2 C 


5 


10 


17 


4 


It 


2, 500 or more 


9 


4 


9 


3 


9 


4 


9 


4 


Total 




594 




224 




1,537 




*61 



$ 9 , 6.1 



0-7 


13^ 


47 


46 


16 


360 


127 


143 


52 


8-19 


77 


37 


27 


13 


208 


98 


85 


4o 


20-49 


4l 


25 


14 


9 


110 


66 


L 5 


23 


50-249 


47 


37 


16 


13 


125 


98 


51 


40 


250-749 


14 


21 


5 


7 


30 


44 


15 


23 


750-2,499 


12 


7 


4 


3 


16 


17 


14 


3 



2 . 500 or more 


9 


3 


9 


2 c 


9 


4 


9 3 


Total 


511 






184 




1,314 


561 


Total Cost 


$ 8,692 




$5,097 


$16,575 


$ 9,233 


August 


0-7 


198 


58 


75 


22 


543 


158 


201 58 


8-19 


100 


40 


38 


15 


273 


109 


101 40 


20-49 


46 


23 


17 


9 


126 


64 


47 24 


50-249 


29 


36 


11 


14 


80 


98 


30 36 


250-749 


11 


42 


4 


16 


29 


44 


11 43 


750 - 2,499 


13 


8 


5 


3 


16 


17 


13 9 


2,500 or more 


9 


3 


8 


2 c 


9 


4 


9 3 



625 



(a) Formulas 1 and 5 , Chapter IV, are used to dote mine optimal sample sizes. 

(b) For definition of industry' groups see Table 9> footnote{b). 

(c) The number of establishments in this stratum was increased to two, the minimum number 
necessary to compute an estimate of the variance. 

Source: Eased on data from all units that responded to the NICB surveys. 
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Table 39* Largest Optimal Sample Size of Each Stratum for Estimating Total Job 
Vacancies Found in Rochester, with Coefficients of Variation of 0.05 
and 0, 10 



Size of 


Coeff i cient 


of Variation of 0.05 


Coefficient 


of Variation of 0,10 


Reporting Unit 


Number of 


Firms in Industry 


Number of 


Firms in 


Industry 


(Number of 




Group ( a) 




Group 




Employee s) 


A 


B 


A 




B 


0-7 


198 


134 


75 




49 


8-19 


100 


40 


38 




15 


20-1+9 


90 


25 


33 




9 


50-21+9 


47 


37 


16 




14 


250-749 


14 


42 


5 




16 


750-2,499 


13 


14 


5 




5 


2 , 500 or more 


9 


4 


9 




3 


Total 




767 




292 




Total Cost 




$11,223 




$6,256 




(a) For definition of indu, 


stry groups see Table 


9* footnote 


(b). 




Source: Based 


on Tables 37 


and 38. 









The sample size thus obtained in Table 39 for a coefficient of variation of 0.05 
would include 150 more establishments than the largest optimal sample given in 
Table 38 for a job vacancy rate of 3*0. The cost would also be increased by about 
$1,700 to a total of $11,200, Furthermore, if an estimate of vacancies with a 
coefficient of variation of 0,10 is all that is required, a sample of 292 establish- 
ments would be sufficient and the cost would be lowered to approximate ly $6,300. 

On the other hand, the assumption can be . jde that the three quarterly 
estimates given in Table 38 differ from one another due only to sampling varia- 
bility, so that the sample to be used should be an average of the three quarterly 
observations, The results of this procedure for various job vacancy rates are 
shown in Table 40. For an area like Rochester a sample of 574 establishments 
v- T ould thus provide estimates of vacancies with a coefficient of variation r f C.05. 
The cost of this sample is estimated at $9,200, which is less than the estimated 
O of an NICB survey for the number of establishments which were included in the 
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Table Uo. Average Optimal Sample Sizes for Estimating Total Job Vacanciei 
According to Specified Job Vacancy Rates 
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Based on all units that responded to the NICE surveys, Tables 37 5 and 33. 
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1965 samples, yet it included about 170 more firms. In other words, an optimal 
sample design for Rochester would include a. larger number of small establishments, 
which have a smaller unit cost, and would cover a. smaller number of large estab- 
lishments (250-2,499 employees) than the NICB sample. 

These illustrative computations demonstrate that, to provide the desired 
precision in estimates, the total sample size must necessarily be increased as the 
job vacancy rate declines. The size of the labor area (as measured by the number 
of establishments) also influences the size of the sample to be used. The data 
presented in Table 40 are only applicable to a labor area similar to Rochester as 
regards establishments, variability of vacancies, and cost per firm. Nonetheless, 
our data illustrates the relation of the sample size to: 

a) the job vacancy rate and/or 

b) the required reliability of the estimates 

In synthesis, the lower the vacancy rate in an area, the larger will be the sample 
size needed to meet requirements of reliability, and the less stringent the relia- 
bility requirements, the smaller the size of the sample needed. Therefore, a 
sample of 1,000 establishments would be adequate to measure vacancies with a 
coefficient of variation of only 0.10 if the vacancy rate were 1.0, yet for a 
vacancy rate of 2.0, this same sample size would estimate vacancies with a co- 
efficient of variation of 0.05. 



Summary 



o 

ERIC 



The design of an optimal sample for job vacancy surveys in a specific 
area should take into account: 

1) the number of establishments (sampling units ) > 

2 ) the distribution of establishments into strata according to number of 
employees and industry, 

3) the differences among strata in vacancy variability and in survey cost 
per firm, end 

4) the job vacancy rate. 
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Tabulations have been furnished shoving optimal size strata for three 
different areas: Hew York, N* Y, , Rochester, N. Y. > and Richmond, Va. Illus- 

trative computations demonstrate that the size of establishments in an area will 
determine both the cut-off point for that stratum which comprises the largest 
establishments to be sampled with certainty and those optimal boundaries Which 
are to be used in defining each size stratum. The suggested method for determin- 
ing stratum boundaries can easily be applied to areas not previously surveyed, 
since it is based on the distribution of establishments by number cf employees, 
such data being readily available. 

The data compiled in the NICB surveys have been used to compute optimal 
sample sizes for a range of possible job vacancy rates. In this connection it has 
been shov:n that sample sizes for an area like Rochester quadruple as the vacancy 
rate diminishes from 3*0 to 1.0 in estimating total vacancies w ’ h a coefficient 
of variation of 0.05- For any area, as the job vacancy rate dinin’ ^hes, larger 
samples must be used to estimate the corresponding number of vac? v ies with the 
same reliability. 

A less stringent requirement of reliability for vacancies reduces sample 
sizes. For example, while a vacancy rate of 2.0 requires a SLuipJe of 1,000 to 
estimate vacancies with a coefficient of variation of 0.05> a sa pie of ^400 would 
be sufficient for a coefficient of variation of 0.10. 
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Appendix k\ PROOFS OF UNBIASED _AMD_ OOgSiaTMT 



g ELEMENT VARIANCE AND ELEMENT COl 



To prove that formula (?) is an unhiased estimate of 
equation (6), Chapter IV, when simple random samples are 
chosen separately from two strata and afterwards collapsed 
to form one stratum, consider the population with values: 



Y 11 X?.l \l Y 12 Y 22 Y N „2 

i ij i 

Stratum 1 Stratum 2 

N - + Np Is the total size of the population. From 

the population select a simple random sample of size n, 
from stratum 1 and a simple random sample of size n^ from 
stratum 2. Denote the sample values as follovjs: 

y ll y 21 y n,l y 12 y 22 y n 0 2 

i i t £_j 

Stratum ] Stratum 2 

n = n^ + n 2 is the total size of the sample selected 
from strata 1 and 2. 

p 

The clement standard error of the population, S , i6: 
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2 

i 



2 N 

Tm^ry 5 y i y j • 



Consider the following: 



0) 




The maximum number of possible samples which include n^ 
elements from stratum 1 and elements from stratum 2 are: 





The number of samples which include a particular elements 
i of stratum 1 are: 




The number of samples which Include a particular element 1 
of stratum 2 are: 
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n N-. „ N 0 

- W~ Sfrn ) 8 + ST S (O 



i=i'* 11 ‘ 



n 2 r.i 12 



and 



(§£%>* + 1 



1 N 2 

H E Y i 
w 1=1 1 



( 2 ) 



An unbiased estimate of the first term of equation (l) is: 



iA n * 



{tt s.(yii)" + 



Tf Vn 



1 i=l 



N. n 2 



‘2 i=l 






( 3 ) 



To find an unbiased estimate of the second term of 
equation (l) v;e note that: (a) The number of samples includ- 
ing two distinct elements i and J from stratum 1 are 
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(b) The number of samples Including two distinct element:! 

/ N. v ^Np-2^ 

1 and J from stratum 2 are ^ n J vn' - 2 ) ’ 



(c) The number of samples Including art element i from 
stratum 1 and an element J from stratum 2 are 



(KxK>. 



< ? vj 



1 



X- 



N 






N, 






2A n 2 > J x il x Jl ...j, 

i+J 



2 ~ 1 12 J2 



C\ ) (np 



Xj-r v n 2 -r v l=l liy V J=1 J2/ 



C? <5p 
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Therefore, 



2 rN 1 (N 1 -l) n i Hp(N p -l) n 2 

llCN-i)Ln 1 (n 1 -l) | y il y jl + rig(n -1) ^ y i2 y J2 






i+J 



N i N 2 ✓ "1 N r "2 m 

+ nj • ^ C^/lO Cjf/je)] 



(5) 



N 



is an unbiased estimate of ' yy E y i y j ’ w tiich the 
second term of equation (l) . 



Note that: 



2 E 
1 



n^ n^-1 p 

\ y il y jl " y il ^+1 y Jl) = 



(6) 



If formula (6) is substituted into (5), and formula (5) and 
(5) are considered together, we have shown that for collapsing 
two strata: 



<5$ j>u> # jS>*} - min « 

r N, /'V 1 Nr/ 1 . N 2 n C s21 N 2^ N 2"S 

fcv[ CryT: yS^^ll) " ^^il^ ] + n g Vn 2 -l) x 
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p 

Therefore, .an unbiased estimate of S , when simple random 

samples are selected from two strata and we collapse these 

2 

to form one stratum, is s where 



1 r Nl sNv \ 2 Ns 1 2 1 1 v 

N '- H l iSi 11 «2 i=l 12 J 



N 0 n 2 



[QViO 2 - ^n' 2 ] + 



N, N p . n l . , n 2 

+ 2-ri • vr C s ) C Z y i?)} 

n l n 2 S=1 iiy V J=1 ^ J 



The following proves that equation (7) of Chapter iv is a 

2 

sistent estimate of S : 




lim (s 2 ) 



n^N 

n g -N 



1 

2 




f Nl 
{ E Y 

1=1 



2 

11 



N £ 

+ t‘ 
1=1 



Y 2 ]■ 
x i2J 
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(7) 



( 8 ) 
con ■ 



122 



ERIC 



N, N, 



N, N, 



" H(N-l){^ N ~ 1 ^[ i ^. 1 Y tl + i ^ 1 Y i2] + i ^ 1 Y il + i=i Y i 2 



N, N 



- + £*i$) - IPX J/f - utWf^ ' 



S 2 . 



To prove that equation ( 11) of Chapter IV is an unbiased 
estimate of equation (10), the element covariance, consider 
the fol lowing: 



N v „ II 



N 

S X i Y i 
i~l 1 1 



( E Xj) ( E Yj) 

v i=l ^ ^1=1 ^ 



N 



XY 



N - 1 



N 

2 X Y 
i=l 1 1 

N - 1 



1 N 

x i Y i 



N N 

2 X. Y. + 2 X. Y, 
i=l 1 1 1, 1 J 

N(N-l) 



M 

i ** 

itJ 

N(N-l) 



( 9 ) 
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n n l n 2 

^l^i* 1 ^ “ E [ i ^ 1 Xliy i 1 + 1 ^ 1 X i2 y i2J 

O 4 V,1 ^ Q) (g) 

<J> c"p 



n N 1 n N 2 

1 ^ 1 X il Y il + W 2 ^ X 12 Y 12 * 



Therefore, 



-N, n l 



n 2 



4 s Cir £,*11*11 + 4 ££12*12)] 



N 



N 



- b {££n Y n + - n j x Vi • < 10 > 

An unbiased estimate of the first term of equation ( 9 ), when 
simple random samples are selected from two strata separately 
vfclch we collapse later to form one stratum, 13: 
n, „ n^ 

(11) 



wN "1 N "2 -v 

H CnJ ££ 11*11 + nj ££ 12 * 12 ) • 



124 



A-10 



To find an unbiased estimate of the second term in equation 
(9) consider: 



4 f vj - 




N 1 
Z X 

ill 



il Y Jl + 



<K 3 s" s . 

1 2 i+J 



X i2 Y J2 








N 1 n (n -1) 

1 X il Y Jl + ^(14 2 -D 



J X 12 Y J2 
i+J 






Therefore, 



p f 1 rV^l -1 * 



n J. Np(Np-l) n 2 

1 X il 7 Jl + nJfnpiT \ x i2 y J2 + 
i*J 2 2 i+J 
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N x Ng N 1 Ng 

• urfclT { ? X 11 Y J1 + i x i2 x j2 + C !: 1 x ij) (Via) 

i*J i*J 1=1 J=I 

N 1 N 2 N 

+ ^ 1 Y ii) ^ X X J2)} = N(tf-l) X i Y j} 

is an unbiased estimate of the second term in equation (9) • 
Notice that 

n l n l n l n l 

1 x il y Jl " (^il) CjJ^il) " 



If we use identity (l?) and the results found in (12) and 
( 11 ) , an unbiased estimate of equation (9), when two strata 
are being collapsed, is: 

i ni N ? " 2 n 

8 xy “ H Cn^ ^*11^1 + £ 1 x i2 y i2t) 

- TTC^TT {n^ (nJ^C^il) ^/il) -^11^1] + 
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To prove that equation (ll) of Chapter IV is a consistent 
estimate of the element covariance, equation (10), consider 
the following: 

M 1 N 2 

n^N = S [ i ^ 1 X il Y il + 1 ^ 1 X i2 Y i2] 



‘1 "1 
n 2 -N 2 



N 1 N x N 1 

KfFTTT K^/il) Q^iO -^Vil 



n 2 n 2 



N, 



+ Q=i x i^i=i Y i^ ■ i=i XisYi2 



N, N 



N, N,. 



♦ S^nX^ta) + C^iO^ia)} 
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N 1 N 2 N 1 
- mfcir ("■'•[“h’ii - + 



M, 



-C 



+ £ X. 0 Y. 0 - { £ X,, + £ X 



N 1 N 2 . > M 1 . «2 



i=l i2 i2 ^i=l 11 i=i. i2 ' v ‘i=3. lil 1=1 12 ' •* 



a) Ojn + AO} 



A £ Vi - FT^IT Q^O C^^i) » S XY • 



Therefore, if simple random samples are chosen from two 

strata separately, an unbiased and consistent estimate of 

the element covariance of the stratum formed by collapsing 

the two strata is s , defined in equation (14) . 

xy 
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